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W  12.0     REVIEW  OF  RESEARCH  LINKING  PAYMENT  TO  IMPROVED  RESIDENT 
v.2-  OUTCOMES265 

12.1     Introduction  -  Traditional  Approach  to  Ensuring  Quality 

The  primary  approach  to  ensuring  quality  in  nursing  homes  has  been  the  establishment  of 
regulatory  minimums  that  facilities  seeking  Medicare  and/or  Medicaid  payment  must  meet.  42 
Code  of  Federal  Regulations  (CFR)  483  Subpart  B  sets  forth  the  regulatory  requirements  for 
nursing  home  performance  and  outlines  residents'  rights.  Compliance  with  these  regulations  is 
monitored  through  onsite  surveys.  In  the  past  several  years,  the  survey  focus  has  shifted  from 
paper  and  process  review  to  evaluation  of  services  provided  and  resident  outcomes. 

Prior  to  the  introduction  of  the  1995  implementing  regulations  for  certain  provisions  of  the 
Omnibus  Budget  Reconciliation  Act  of  1987  (OBRA  '87),  the  only  available  redress  for  facility 
noncompliance  was  termination  of  participation  in  the  Medicare  and/or  Medicaid  programs,  denial 
of  payment  for  new  admissions,  or  closure  (under  the  State's  licensure  authority).  The  current 
enforcement  system,  however,  contains  a  number  of  sanctions  that  alternately  intervene  to 
effectuate  the  remedying  of  a  problem  (by  directing  inservices  for  staff,  assigning  a  temporary 
manager,  or  directing  a  plan  of  correction)  and  penalize  poor  performance  (by  imposing  sanctions 
such  as  civil  money  penalties  or  denial  of  payment  for  all  residents). 

Traditional  points  of  contention  concerning  the  survey  and  enforcement  processes  have  been 
issues  such  as:  a  tendency  to  focus  on  facilities  meeting  minimum  rather  than  optimum 
performance  standards;  inability  to  survey  for  the  less-concrete  quality  of  care  and  life  issues; 
undercitation  for  such  issues;  and  inaction  or,  since  the  introduction  of  the  alternative  remedies, 
anemic  sanctioning,  particularly  for  deficiencies  in  quality  of  life.266  Several  of  these  points  were 
substantiated  by  research  conducted  on  the  1990  survey  process,267  and  in  response,  modifications 
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The  ombudsman  survey  portion  of  this  report  (Chapter  1 6)  details  specific  ombudsman  concerns  with  survey 
and  enforcement. 

In  its  7996  Evaluation  of  the  Long  Term  Care  Process  final  report,  Abt  Associates  reviewed  the  1990  survey 
process  (which  was  significantly  revised  in  1995)  and  found  that: 

"There  are  some  quality  of  life  and  quality  of  care  requirements  that  surveyors  find  more  difficult  to  assess  than 
others.  Surveyors  find  it  difficult  to  assess  issues  with  the  following  characteristics: 

•  It  is  difficult  to  obtain  firsthand  observation  and/or  documentation; 

•  Assessments  are  required  that  surveyors  feel  are  outside  the  scope  of  their  professional  training; 

•  The  frequency  is  limited  to  one  or  a  few  residents; 

•  The  frequency  is  limited  and  judgment  of  seventy  must  consider  possible  future  outcomes;  and 

•  The  frequency  may  or  may  not  be  limited,  but  judgement  of  severity  must  consider  if  current  outcomes 
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were  made.  The  revised  requirements  for  participation  focus  on  helping  residents  reach  their 
highest  potential  by  providing  necessary  care  and  services.268  Facilities  may  be  cited  for  failure  to 
promote  this  achievement.  However,  whether  the  underlying  difficulty  of  assessing  this  type  of 
deficiency  as  described  in  the  1996  Abt  study  has  been  resolved  is  questionable.  Critics  argue  that 
the  emphasis  placed  on  optimum  resident  outcomes  (versus  a  focus  on  actual  harm  incurred, 
which  is  easier  to  cite  because  it  is  more  easily  documented  and  is  supportable  in  court)  varies  by 
State.  While  regulators  posit  that  there  is  a  regulatory  emphasis  on  optimum  outcomes,  questions 
remain  about  how  this  emphasis  is  interpreted  and  implemented  in  the  field. 

While  payment  may  be  suspended  altogether  for  failure  to  meet  regulatory  requirements, 
Medicare  reimbursement  is  not  linked  to  the  many  possible  gradations  of  nursing  home 
performance  above  the  minimum.  HCFA  has  not  structured  a  reimbursement  system  that 
differentiates  between  passable  and  excellent  care.  Generally,  Medicare  payment  is  not 


could  have  been  better."  (Abt  Associates,  p.  iv.) 

Abt  also  found  that  "quality  of  life  concerns  are  often  underemphasized,"  and  "particularly  problematic  are 
judgements  of  outcomes  that  should  have  been  or  that  might  occur  in  the  future."  In  response  to  these 
concerns,  the  Health  Care  Financing  Administration  (HCFA)  issued  the  1 995  changes  to  the  survey  process. 

Regulations  at  42  CFR  483.20(d)(1)  (Resident  assessment;  Comprehensive  care  plans)  require  facilities  to 
create  comprehensive  care  plans  that  address  the  care  and  services  that  the  resident  needs  to  reach  his  or  her 
highest  practicable  level  of  physical,  mental,  and  psychosocial  well-being  (failure  to  meet  this  requirement  is 
cited  by  the  State  survey  agency  (SA)  team  under  Federal  citation  tag  F279).  42  CFR  483.25  (Quality  of  care) 
requires  that  the  care  and  services  to  achieve  highest  practicable  level  of  well-being  are  received  by  residents 
and  provided  by  the  facility  (Federal  citation  tag  F309). 

Data  in  Harrington  et  al's  1995  Stale  Data  Book  on  Long  Term  Care  Program  and  Market  Characteristics 
indicate  that  nationally  from  July  to  December  of  1995,  23.8  percent  of  facilities  surveyed  were  cited  for  failure 
to  comply  with  483  .20(d)(1)  (F279),  the  care-planning  requirement.  This  represents  a  significant  decrease 
from  the  32.4  percent  documented  for  1 991 .  Possible  causes  for  this  change  have  not  been  analyzed.  Tag  309 
(quality  of  care)  has  increased  in  citation,  from  3.3  percent  of  facilities  surveyed  receiving  a  citation  in  1991  to 
1 2.6  percent  in  July  to  December  1 995.  It  is  unclear  exactly  what  Tag  309  captures,  i.e.,  whether  it  specifically 
indicates  the  failure  to  provide  services  and  care  so  that  residents  reach  their  highest  practicable  level. 
Examination  of  the  interpretive  guidelines  found  in  the  State  Operations  Manual  (PP  83)  and  discussion  with 
Karen  Schoeneman,  one  of  the  HCFA  analysts  with  primary  responsibility  for  developing  policy  and  providing 
training  for  the  long-term  care  survey  process  indicate  that  surveyors  are  to  use  Tag  309  for  quality  of  care 
deficiencies  not  covered  by  42  CFR  483.25(a)  through  (m).  So,  in  effect,  this  tag  may  have  become  a  catch-all. 
Further,  Schoeneman  notes  that  the  assumption  that  all  failure  to  achieve  highest  practicable  level  is  cited 
under  these  two  tags  is  inaccurate.  Since  the  whole  survey  regulation  is  driven  by  the  philosophical  changes 
introduced  by  OBRA  '87,  a  citation  could  be  made  under  any  of  the  outcome  requirements  for  such  failure. 
Schoeneman  reports  that  in  training  surveyors,  HCFA  has  attempted  to  redirect  them  so  that  the  most  specific, 
appropriate  tag  and  the  most  pertinent  regulation  are  used  m  writing  the  deficiency,  therefore,  surveyors  have 
been  steered  away  from  using  F309,  except  as  a  general  tag  when  unable  to  find  a  more  specific  one  that  is 
applicable. 
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variable.269  State  Medicaid  reimbursement  systems  typically  represent  a  permutation  of  one  of  five 
general  rate-setting  methodologies,270  which  may  use  flat-fee  or  case-mix  reimbursement  for 
facility  payment.271  At  this  point,  however,  neither  Medicare  nor  Medicaid  base  payment  on 
optimum  quality  outcomes. 

12.2    An  Alternative  Approach  to  Ensuring  Quality 

Another  possible  approach  to  ensuring  quality  in  nursing  homes  can  be  found  at  42  CFR  488.303 
(State  plan  requirement).  Subsection  (b)  provides  that,  "A  State  may  establish  a  program  to 
reward,  through  public  recognition,  incentive  payments,  or  both,  nursing  facilities  that  provide  the 
highest  quality  care  to  Medicaid  residents."  The  regulation  goes  on  to  explain  that  the  costs  for 
carrying  out  such  a  program  can  be  submitted  under  the  State  plan.  Although  available  for 


There  are  two  regulatory  provisions  under  which  a  higher  rate  of  reimbursement  is  allowed.  The  first  is  for 
new  providers  of  inpatient  services.  New  providers  may  request  an  exemption  from  the  general  Medicare 
reimbursement  rates,  provided  they  meet  certain  criteria  (see  42  CFR  413.30(e)).  According  to  HCFA's 
Provider  Reimbursement  Manual,  section  2533. 1  A,  "This  provision  was  implemented  to  recognize  the 
difficulties  in  meetmg  the  applicable  cost  limits  due  to  underutilization  during  the  initial  years  of  providing 
skilled  nursing  and/or  rehabilitative  services,  either  directly,  through  arrangements,  or  by  agreement."  In  1996, 
HCFA  received  384  requests  for  exemption;  240  were  approved,  142  were  denied,  and  2  were  either 
withdrawn  or  returned  for  lack  of  documentation.  (Information  provided  by  Julie  Stankivic,  HCFA) 

The  second  provision  permits  a  higher  reimbursement  rate  when  nursing  hor-.es  request  an  exception  based  on 
one  of  the  conditions  found  at  42  CFR  413  .30(f)(1)  through  (5).  42  CFR  413  .30(f)  provides  that  upward 
adjustment  in  the  rate  may  be  made  if  costs  are  determined  to  be  reasonable,  incurred  under  one  of  the 
circumstances  descnbed  (1 )  through  (5),  separately  identified  by  the  provider,  and  verified  by  the  intermediary. 
The  five  regulatory  circumstances  include:  the  provision  of  atypical  services;  extraordinary  circumstances,  such 
as  a  natural  disaster  ,  location  in  an  area  with  fluctuating  populations,  the  operation  of  medical  and  paramedical 
education;  and/or  unusual  labor  costs.  For  a  more  thorough  review  of  the  criteria  for  exception,  see  42  CFR 
413.30(f)(1)  through  (5)  and  the  Provider  Reimbursement  Manual,  section  2534.  In  the  past  2  years,  HCFA 
has  approved  1800  exceptions  and  denied  377. 

In  the  1995  State  Data  Book  on  Long  Term  Care  Program  and  Market  Characteristics,  Harrington  et  al 
categorized  reimbursement  systems  under  five  broad  categories:  retrospective  payment  (usually  based  on  costs 
of  providing  care)  ,  prospective  class  (rates  are  set  m  advance  by  using  a  flat  rate  for  groups  of  facilities); 
prospective  facility-specific  (rates  are  set  by  looking  at  historical  costs  for  individual  facilities  and  other 
factors);  prospective  adjusted  (which  allow  upward  adjustments  to  be  made  during  a  period,  generally  based 
upon  cost);  and  combmation  of  prospective  and  retrospective.  Some  States  adjust  rates  based  upon  resident 
characteristics  (case-mix  reimbursement).  This  feature  can  be  applied  to  anv  of  the  five  rate-setting  methods. 
(P-  4) 

In  1 995,  Harrington  et  al  reported  that  case-mix  methods  were  then  being  used  by  25  States.  "Such  methods 
may  improve  access  for  heavy  care  patients,  enhance  quality  of  care,  increase  facility  efficiency,  and  more  fairly 
treat  facilities  on  the  basis  of  patients  admitted.  Casemix  systems,  however,  can  create  incentives  to  increase 
patient  dependence  and  could  have  negative  effects  on  quality  of  care,  depending  upon  how  the  systems  are 
designed  and  monitored."  (p.  4) 
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Medicaid,  no  parallel  regulations  exist  to  provide  regulatory  authority  for  such  a  program  to  be 
implemented  for  Medicare. 

Although  the  regulations  clearly  provide  for  their  use  under  Medicaid  plans  and  some  States  have 
at  one  time  or  another  tried  out  incentives  systems,  a  literature  search,  discussion  with  researchers 
and  field  experts,  and  interviews  with  various  State  officials  did  not  reveal  that  there  is  currently 
any  State  that  has  such  a  system  in  operation.  In  discussion,  a  number  of  leading  long-term  care 
researchers  react  favorably  to  the  concept  of  using  such  a  system.  It  seems  odd  that  an  idea  that 
receives  a  highly  favorable  reception  in  some  quarters  (although  not-so-favorable  in  others),  that 
has  been  discussed  at  length  since  1980,  has  not  been  operationalized  with  any  great  success. 
Although  there  is  argument  about  the  effectiveness  of  what  is  perhaps  the  best  documented 
experiment  involving  incentive  payment,  the  fact  remains  that  there  is  no  workable  system  waiting 
in  the  wings  for  implementation.  In  discussion  with  researchers,  even  the  ones  who  espouse  the 
use  of  incentives  for  improving  care  and  outcomes  suggest  that  further  demonstration  would  be 
necessary  before  such  an  incentives  system  could  be  implemented.  What  is  the  history  of 
incentive  payment,  and  what  are  the  barriers  to  its  successful  use?  Is  this  a  viable  option  that 
could  advance  quality  of  care  and  life  for  nursing  home  residents  as  a  supplement  to  or  instead  of 
traditional  regulatory  methods? 

This  report  will: 

•  Examine  the  history  and  use  of  incentives  in  nursing  homes,  particularly  when  tied  to 
improved  resident  outcomes; 

•  Describe  assessments  of  the  incentives  concept  made  by  researchers  who  have  conducted 
work  in  this  area; 

•  Identify  current  work  related  to  incentives;  and 

•  Suggest  possible  recommendations  for  steps  to  be  taken. 

12.3     Methods  of  Investigation 

As  a  first  step  in  investigating  the  history  of  incentive  payment,  HCFA  contacted  researchers  with 
a  background  of  involvement  in  the  long-term  care  field.  Their  opinions  were  solicited  by 
telephone  interview  and  electronic  mail.  HCFA  questioned  experts  about  literature  and 
experiments  related  to  incentive  payment,  the  names  of  peers  or  contacts  who  might  have 
additional  information  or  opinions,  and  their  own  viewpoints  on  the  plausibility  of  an  incentive 
payment  system,  pros  and  cons,  and  the  existence  of  a  workable  system.  A  listing  of  personal 
interviews  is  noted  at  the  end  of  this  report,  along  with  standard  bibliographic  information.  While 
it  is  entirely  possible  that  persons  other  than  those  interviewed  may  have  had  a  part  in  past 
Medicaid  incentives  programs  and  may  still  work  for  that  State's  government,  locating  them 
proved  quite  challenging.  Primarily  HCFA  relied  upon  referrals  from  researchers  and  sources  in 
other  States  who  remembered  having  certain  contacts  about  this  issue.  Telephoning  the  State 
health  departments'  survey  and  licensure  offices  proved  to  be  a  futile  method  for  tracking  down 
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those  who  were  involved  with  tne  programs.  None  of  the  States  that  once  had  incentives 
programs  currently  have  them  in  operation  (for  example,  Illinois'  program  ceased  operation  in 
1991  or  1992).  Personnel  have  changed.  The  terms  "incentive  payment"  or  "incentives  programs" 
bring  to  mind  a  host  of  divergent  images  and  meanings  to  each  person  spoken  to,  which  often 
resulted  in  being  directed  to  an  inappropriate  person.  Therefore,  interviews  with  State  officials 
are  added  as  anecdotal  supplements  and  should  not  be  seen  as  an  exhaustive  representation  of  the 
States'  opinions. 

An  electronic  literature  search  for  relevant  periodical  and  journal  articles  was  performed,  and 
relevant  articles  were  reviewed. 

12.4     Types  of  Incentives 

Discussions  of  incentives  tend  to  be  about  one  form  of  payment  or  another,  although  an  equally 
valid  incentive  could  be  recognition  or  an  award,  as  noted  in  the  regulation.  Illinois,  whose 
incentive  program  for  Medicaid  will  be  discussed  in  detail,  employed  both  financial  and  non- 
financial  varieties.  However,  one  could  argue  that  in  the  end,  even  a  recognition  incentive  has  a 
financial  component  in  that  recognition  translates  into  a  marketing  tool.  The  possible  impact  of 
non-financial  incentives  is  mentioned  in  Geron's  evaluation  of  the  Illinois  incentives  system.  A 
number  of  the  system's  design  limitations  made  evaluation  of  the  impact  of  the  financial  versus 
the  non-financial  incentives  impossible,  and  broader  research  on  the  effect  of  non-financial 
incentives  is  scant. 

Financial  incentives  have  a  slight  advantage  in  that  more  research  has  examined  the  effect  of 
payment  on  nursing  home  behavior,  although  typically  studies  have  not  addressed  the  impact  on 
residents'  health  or  well-being.  Studies  have  looked  at  various  aspects  of  payment,  and  the  term 
"incentive  payment"  has  been  used  rather  loosely  to  describe  various  nursing  home  reimbursement 
strategies  that  have  been  examined  and/or  implemented  over  the  past  15  to  20  years.  As 
discussed  in  this  report,  "incentive  payment"  does  not  refer  to  a  general  revamping  of  the 
Medicare/Medicaid  payment  structures  or  an  overall  increase  in  payment  levels  for  caring  for 
nursing  home  residents.272  Such  a  series  of  changes  might  legitimately  be  seen  as  an  incentive  to 
improve  care,  broaden  nursing  home  access  for  Medicaid  recipients,  or  achieve  some  other 
positive  outcome;  however,  such  ideas  have  been  the  subject  of  research  that  is  outside  the 
purview  of  this  report. 

In  the  context  of  this  report,  "incentive  payment"  refers  to  money  paid  to  nursing  homes  in 
addition  to  the  regular  reimbursement  for  Medicare  or  Medicaid 


Relevant  research  on  this  topic  includes  Joel  Cohen  and  William  Spector's  "The  effect  of  Medicaid 
reimbursement  on  the  quality  of  care  in  nursing  homes"  (Journal  of  Health  Economics  15  (1996)  23-48)  and 
Nyman's  improving  the  Quality  of  Nursing  Home  Outcomes;  Are  Adequacy-  or  Incentive-Oriented  Policies 
More  Effective?"  (Medical  Care,  December  1988,  Vol.  26,  No.  12). 
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12.5     Medicaid  Incentive  Payment  Systems 


12.5.1  Past  State  Efforts 

12.5.1.1  Illinois 

The  Illinois  Department  of  Public  Aid  initiated  a  program  called  the  Quality  Incentive  Program 
(QUIP)  in  1985,  which  had  as  its  goals:  "to  establish  a  standard  of  excellent  care  in  nursing  homes 
that  is  measurable  and  obtainable;  instruct  facility  administrators  about  the  standards;  and  offer 
positive  financial  incentives  to  facilities  to  bring  about  positive  improvement."273  To  that  end,  the 
State  created  six  targeted  components  that  were  thought  to  be  indicative  of  or  conducive  to 
quality  of  life.  Participation  in  the  QUIP  program  was  voluntary,  and  facilities  were  able  to 
choose  which  of  the  six  components  they  wished  to  qualify  for  the  incentives  in,  and  to  determine 
when  t.hey  would  be  visited  by  surveyors. 

Positive  reinforcement  systems  rewarding  certain  nursing  home  behaviors  or  the  achievement  of 
specific  goals  could  take  on  a  number  of  faces,  which  Illinois'  system  did  shortly  after  its 
implementation.  In  addition  to  a  monetary  reward,  facilities  qualifying  for  the  incentive  in  any  of 
the  six  areas  were  given  a  star-rating  form  of  recognition.  For  example,  a  facility  electing  to  aim 
for  achievement  in  all  six  QUIP  areas  and  successfully  achieving  that  goal  would  be  given  a  six- 
star  rating. 

A  1991  evaluative  article  by  Geron  in  The  Gerontologist  discussed  some  of  the  shortcomings  in 
the  design  of  the  QUIP  system.274  Not  only  were  there  no  control/comparison  groups,  but  there 
was  also  no  valid  "before  and  after"  quality  data  for  the  participating  facilities.  The  "evaluation" 
data  consisted  essentially  of  the  descriptive  statistics  of  participating  facilities.  Other  events 
occurring  during  the  period  that  the  QUIP  was  in  effect  may  have  affected  results.  Geron  also 
noted  problems  such  as  the  subjectivity  of  some  of  the  measures  used  to  judge  performance  in  the 
six  components  and  questioned  their  face  validity.  With  one  exception,  measurement  of 
performance  in  a  certain  component  relied  on  process  or  structure  criteria.  He  gave  as  an 
example  one  of  the  criteria  from  the  structure  and  environment  component.  To  promote  homelike 
environment,  one  structural  item  asked: 

"Are  there  various  items  in  the  facility  to  stimulate  the  residents,  i.e.,  fish  bowls  or  tanks, 
music,  plants,  radios?  [This  question  was  scored  as  follows:] 

6=  Several  in  every  congregate  area  including  at  least  three  different  items. 


Geron,  S.M.  Regulating  the  Behavior  of  Nursing  Homes  Through  Positive  Incentives:  An  Analysis  of  Illinois' 
Quality  Incentive  Program  (QUIP).  The  Gerontologist  31  (3):  293,  1991. 

274         Ibid,  p.  294,  295. 
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3= At  least  one  in  every  congregate  area,  and  at  least  three  different  kinds  of  items 

throughout  the  facility. 

0=None. 

There  are  many  anecdotal  accounts  of  facilities  renting  flowers  or  fish  tanks  or  buying 
plastic  plants  for  the  QUIP  survey.  In  spite  of  a  reasonable  idea  to  measure  a  facility's 
environment,  there  is  simply  no  necessary  relationship  between  fish  bowls,  plants,  and  the 
like  and  a  'homelike  environment,'  the  outcome  this  component  was  designed  to 
achieve."275 

Geron's  examination  of  the  QUIP  system  highlights  several  potential  issues  that  any  system 
employing  non-financial  incentives  might  experience.  Geron  reported  anecdotal  information 
suggesting  that  "the  star  system  misrepresents  the  care  provided  in  nursing  homes  and  is 
confu«ing  to  consumers  because  it  suggests  that  other  dimensions  of  care  may  be  overlooked  or 
are  assumed  to  be  factored  into  the  scoring  system."276  QUIP  participants  received  calls  from 
consumers  who  were  only  interested  in  how  many  stars  the  nursing  home  had  qualified  for 
without  asking  other  pertinent  questions.  Typically,  in  looking  at  a  nursing  home,  a  consumer 
might  look  at  the  facility's  last  annual  survey  report,  complaint  reports,  and/or  the  facility  itself  via 
an  onsite  visit.  According  to  Geron,  however,  the  elevated  importance  of  the  star  rating  was  not 
only  found  among  consumers;  the  use  of  the  star  rating  may  have  resulted  in  some  surveyors 
viewing  the  star  system  as  the  true  quality  ranking  of  nursing  homes.277 

Geron's  review  concluded  that  in  some  respects  the  QUIP  was  successful  in  achieving  its 
objectives;  specifically,  the  program  had  a  very  high  participation  rate  and  there  was  an  increase  in 
the  percentage  of  facilities  that  met  most  or  all  of  the  identified  components  of  the  program.278 
Geron  noted,  however,  that: 

Unfortunately,  it  is  impossible  to  determine  whether  the  program  succeeds  in  improving 
resident  care,  as  its  designers  claim,  or  simply  represents  the  ability  of  providers  to  meet 
standards  that  may  not  have  anything  to  do  with  resident  care  quality,  as  some  of  its 


Ibid,  p.  295. 
Ibid,  p.  300. 
Ibid,  p.  300. 
Ibid,  p.  299. 
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detractors  allege.279  Design  limitations  also  made  it  impossible  to  isolate  the  differential 
contribution  of  the  various  QUIP  program  features.280 

Lee  Christy,  who  works  for  the  Illinois  Department  of  Public  Aid,  was  familiar  with  the  QUIP  and 
noted  in  personal  communication  that  the  QUIP  ended  in  1991  or  1992.  OBRA  '87  displaced 
much  of  the  need  for  the  program  by  introducing  increased  focus  on  the  targeted  QUIP  areas  and 
changing  regulations  in  those  areas.  However,  Ms.  Christy  commented  that  the  QUIP  had  several 
commendable  features,  such  as  encouraging  facilities  to  look  at  opening  and  expanding  care  and 
services  and  promoting  creative  approaches  to  improving  quality.  Voluntary  participation  in  the 
QUIP  prompted  cooperation  and  conducive  information  exchange  in  a  non-combative 
environment  The  QUIP  also  focused  on  what  were  then  agreed-upon  areas  of  importance. 

When  questioned  about  its  shortcoming,  Ms.  Christy  replied  that  one  problem  was  the  cost 
continually  growing.  Additionally,  there  was  never  definitive  information  indicating  that  the 
QUIP  made  a  difference.  At  the  time  the  QUTP  was  running,  she  explained,  research  on 
effectiveness  was  difficult  to  perform  because  outcome  measures  were  not  as  sophisticated  as  they 
are  now.  Although  several  State  schools  analyzed  the  program,  there  was  not  much  conclusive 
evidence.  Ms.  Christy  also  commented  that  facilities  with  a  high  Medicaid  census  could  not 
afford  the  additional  care  approaches  involved  in  the  QUIP  program  because  the  incentive 
payments  offered  did  not  cover  the  cost  of  implementing  the  changes  needed.  The  facilities  with 
lower  Medicaid  censuses  who  used  the  star-rating  for  a  marketing  tool  were  able  to  pass  the  cost 
of  implementation  along  to  the  private-pay  residents. 

12.5.1.2  Florida 

As  Geron  stated  in  his  evaluation  of  the  Illinois  QUIP,  "Systematic  analysis  of  the  few  states  that 
have  developed  these  [incentives]  systems  has  been  impaired  by  a  number  of  factors,  including 
inadequate  record  keeping,  insufficient  data  systems  capability,  lack  of  clear  quality  improvement 
objectives,  and  frequent  program  changes."281  Unfortunately,  Geron' s  article  and  analysis  of  the 
QUIP  program  is  the  only  readily  available  information  on  any  of  the  Medicaid  incentive 
programs.  In  discussion  with  three  representatives  from  the  Florida  Agency  for  Health  Care 


These  doubts  are  further  supported  by  a  reported  analysis  of  Chicago  facilities  which  found  no  relationship 
between  QUIP  performance  indicators  and  an  independent  set  of  measures  derived  from  HCFA  Facility 
Summary  data  (e.g.,  percent  of  residents  receiving  a  psychotropic  medication).  Although  such  a  relationship 
was  found  within  skilled  nursing  facilities,  it  should  be  noted  that  there  was  no  control  in  this  analysis  for  prior 
performance  on  the  HCFA  measures  before  QUFP  was  implemented 

Geron,  p.  299. 

Ibid,  p.  292. 
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Administration,  none  of  them  were  aware  of  any  published  research  or  analysis  about  the 
effectiveness  of  that  State's  incentives  program.282 

According  to  the  interviews,  in  1983,  the  State  legislature  made  appropriation  for  the  incentives 
program.  Initially,  Florida  started  with  two  incentives.  The  first  focused  on  promoting 
administrative  cost  containment,  if  a  nursing  home  was  able  to  lower  its  administrative  costs,  it 
was  permitted  to  keep  the  savings.  The  second  focused  on  performance.  Even  before  the 
incentives  program  started,  Florida  nursing  homes  received  ratings  based  on  compliance  with  the 
licensure  and  certification  survey,  such  as  conditional,  standard,  or  superior.  It  is  unclear  what 
comprised  the  "superior"  rating,  whether  that  determination  was  made  by  looking  at  performance 
with  State-specified  criteria,  or  whether  it  was  a  reflection  of  exceptional  performance  in  the 
Federally-defined  areas  looked  at  during  the  annual  licensure  and  certification  survey. 

Originally,  however,  the  attainment  of  a  superior  rating  earned  the  financial  incentive.  The 
incentive  money  was  to  be  spent  on  the  nursing  home's  care;  for  example,  the  incentive  payment 
might  be  used  for  staff  improvement,  such  as  hiring  staff  members  with  higher  levels  of  education 
and  training. 

Over  the  years,  the  State's  legislature  focused  on  cost  reduction,  which  resulted  in  the  incentive 
payment  program  being  cut.  Currently,  however,  by  reallocating  existing  funds  the  State  uses  a 
Medicaid  adjustment  rate  (MAR).  This  payment  comes  in  addition  to  the  standard  rate  Facilities 
are  eligible  if  they  pass  the  annual  licensure  and  certification  survey  and  if  they  have  a  certain 
Medicaid  occupancy  rate.  If  that  rate  is  below  50  percent,  the  facility  is  ineligible.  From  50  to  90 
percent  Medicaid  occupancy,  the  amount  of  the  adjustment  is  pro-rated.  For  greater  than  90 
percent  Medicaid  occupancy,  the  facility  qualifies  for  a  4  5  percent  bonus.  It  appears  that  this 
additional  payment  is  geared  toward  increasing  access  to  nursing  homes  for  Medicaid 
beneficiaries  rather  than  promoting  optimum  outcomes. 

When  asked  whether  incentive  payment  could  work,  one  respondent  replied  that  they  could  work 
in  an  environment  where  the  incentives  were  not  being  used  to  supplement  an  inadequate 
reimbursement  system.  If  the  incentive  is  being  used  in  that  manner,  it  may  prevent  degradation 
of  care,  which  is  not  the  same  as  promoting  optimum  care.  An  second  concern  voiced  was  using 
incentives  in  the  cost-based  reimbursement  scenario.  In  the  Florida  system,  performance 
incentives  were  required  to  be  funneled  back  into  the  care-related  areas  of  the  facility.  This  lead 
to  the  improvements  appearing  on  the  nursing  home's  next  cost  report,  causing  inflationary 
growth  in  basic  costs.  Incentive  payments  need  to  be  used  within  a  fee-based  or  capitated 
reimbursement  system  to  avoid  this  problem.  A  third  issue  was  that  while  it  could  be 
demonstrated  that  facilities  obtaining  incentive  payments  had  inflationary  increase  in  basic  costs, 


Per  personal  communication  with  Mr.  Dyke  Snipes,  Mr.  Erwin  Bodo,  and  Mr.  John  Owens. 
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increased  quality  could  not  be  proven.  A  fourth  possible  problem  with  a  system  like  Florida's  is 
dealing  with  the  administrative  work  associated  with  appealed  decisions  of  non-superior  rating. 

12.5.1.3  Massachusetts 

For  a  time  Massachusetts  had  an  incentive  payment  system.  Paul  Dreyer,  Deputy  Director, 
Bureau  of  Health  Care  Quality  for  the  Massachusetts  Department  of  Public  Health,  indicated  that 
there  was  an  evaluation  of  the  State's  program  by  an  MIT  student.  This  analysis  showed  an 
improvement  in  facility  scores  (in  Massachusetts,  the  Federal  nursing  home  regulations  were 
weighted  to  reflect  importance  in  contributing  to  quality  of  care,  and  the  degree  of  compliance 
was  measured  on  a  0  to  5  scale,  0  being  perfect  compliance,  5  being  extreme  non-compliance).  A 
literature  review,  however,  was  unable  to  unearth  this  research,  perhaps  because  it  may  have  been 
unpublished. 

12.5.1.4  Summary 

Long-term  care  researchers  mentioned  other  States  as  having  had  some  sort  of  incentive  payment 
system  at  one  time.283  Researchers  were  unaware  of  any  currently-operating  true  incentive 
payment  systems;  however,  in  discussion  with  officials  in  the  aforementioned  States,  several 
expressed  interest  in  re-examining  or  actually  implementing  an  improved  incentive  payment 
system  in  the  Medicaid  programs.  Indeed,  several  indicated  that  efforts  to  examine  the 
introduction  of  such  systems  were  already  underway. 

12.5.2  Future  State  Efforts 

The  State  of  Minnesota's  legislature  has  authorized  the  use  of  an  incentives  system  that  could 
offer  up  to  5  percent  payments  to  nursing  facilities  (although  the  extra  funds  for  these  payments 
were  not  appropriated).  Incentive  payment,  however,  is  only  a  small  part  of  larger  efforts  to 
establish  a  continuous  quality  improvement  (CQI)  system  to  monitor  nursing  homes  and 
encourage  better  performance. 


In  R.J.  Buchanan's  1988  Medicaid  Nursing  Home  Reimbursement  Survey,  1 5  States  responded  that  they  had 
quality  of  care  incentives  in  their  payment  systems  (DE,  FL,  EL,  IN,  KS,  MA,  MI,  MN,  MT,  NY,  NC,  OR,  UT, 
WA,  WY).  On  average,  survey  respondents  rated  their  incentives'  effectiveness  as  slightly  more  than  moderate. 
The  1 991  article  that  describes  the  survey  and  its  findings  did  not  define  what  would  qualify  as  a  "quality  of 
care  incentive,"  but  provided  as  an  example  the  adjustment  of  payment  to  reflect  scores  on  licensing  and 
certification  reviews.  As  discussed  earlier,  to  some  "quality  of  care  incentive"  may  represent  a  reward  for 
meeting  the  threshold  standards  for  Medicare  and  Medicaid  certification  rather  than  for  providing  care  beyond 
the  minimum  requirements.  It  is  unclear  whether  the  15  States'  quality  of  care  incentives  fell  into  the  former  or 
latter  categories  or  represented  both.  The  information  is  dated  and  finding  documentation  to  desenbe  these 
incentives  has  been  difficult,  as  has  unearthing  relevant  contact  persons,  so  that  attempts  to  piece  together  what 
these  systems  may  have  been  like  have  not  been  fruitful. 
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In  Minnesota,  contract  purchasing  for  nursing  home  services  (as  opposed  to  the  current  cost 
reimbursement)  is  seen  as  the  coming  trend.  Contract  purchasing  will  most  likely  represent  a  shift 
toward  increased  outcomes  observation  and  measurement.  Maria  Gomez,  who  works  in  the 
State's  Department  of  Human  Services,  reported  that  in  January  or  February  1998,  the  State 
hopes  to  get  the  Minimum  Data  Set  (MDS)  software  up  and  running  for  all  of  the  homes  that 
have  elected  to  participate  in  the  contract-based  purchasing  system  (facilities  can  opt  to  receive 
cost-related  reimbursement  instead).  (The  MDS  captures  information  about  the  physical,  mental, 
and  psychosocial  functioning  of  individual  residents  and  is  updated  periodically  or  at  any  point 
when  there  is  a  significant  change  in  the  resident's  status.)  The  State  plans  to  monitor  all  MDS 
indicators  initially,  then  determine  which  indicators  are  better  predictors  of  good  resident 
outcomes.  A  CQI  system  will  be  based  on  the  indicators,  measuring  a  nursing  home's  current 
performance  against  the  information  taken  as  its  baseline.  At  this  point,  the  likelihood  of  being 
able  to  use  that  information  to  compare  one  nursing  home  to  another  is  unknown.  Using  the  data, 
the  State  and  each  nursing  home  will  cooperatively  set  goals  for  improvement.  Gomez 
emphasized  the  importance  of  recognizing  progress  in  individual  homes  since  a  goal  is  to  see 
improvement  in  all  homes. 

How  incentive  payment  could  or  will  be  rolled  into  the  CQI  program  is  unclear.  Gomez  offered 
what  appears  to  be  a  common  concern  about  offering  extra  payment  for  what  nursing  homes 
should  already  be  doing.  She  also  noted  that  until  the  validity  and  reliability  of  the  MDS  data  is 
established,  they  "can't  even  talk  about"  incentive  payment  usage.  Further,  Gomez  had  doubts 
about  establishing  the  link  between  CQI  and  incentive  payments.  "Connecting  this  to  money  is  a 
hindrance  rather  than  a  help,"  she  stated,  because  of  the  tendency  to  have  the  money  rather  than 
quality  become  the  object  of  the  effort. 

Philosophical  objections  aside,  how  an  incentives  system  without  funding  could  work  is  a  puzzle. 
A  true  incentives  system,  one  where  a  reward  is  offered  in  addition  to  basic  payment,  is  not  cost 
neutral.  While  returning  to  the  legislature  to  ask  for  funding  is  a  possibility,  the  idea  of 
withholding  part  of  the  standard  payment  (up  to  5  percent)  and  releasing  it  based  on  achievement 
of  certain  goals  was  also  mentioned  in  conversation. 

LaRhae  Knatterud  serves  as  a  member  on  a  State-formed  workgroup  composed  of  public  and 
private-sector  representatives  that  is  looking  at  the  issues  related  to  incentive  payment,  contract- 
based  purchasing,  and  the  CQI  hopes  for  nursing  homes  in  Minnesota.  The  methodology  for 
payment  and  the  key  indicators  to  measure  achievement  (and  thus  qualification  for  incentive 
payment)  had  not  yet  been  established  at  the  time  of  the  interview  (August  1997).  Knatterud 
indicated  that  about  1 12  of  the  State's  450  facilities  will  participate,  and  in  the  next  year  and  a 
half,  the  number  of  participants  may  rise  to  half  of  the  facilities  in  the  S*ate.  Part  of  the  appeal  of 
participating  in  the  incentives  program  is  the  contract  approach,  which  gives  nursing  homes  more 
flexibility  in  allocating  funds  and  requires  less  cost  reporting. 
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One  question  related  to  an  MDS-based  incentives  system  is  how  well-validated  the  MDS 
information  is.  Knattemd  noted  that  Minnesota  may  need  to  perform  spot  checks  to  ensure 
accurate  completion  of  the  MDS  forms  completed  by  nurses  within  the  facilities.  Basing  incentive 
payment  on  self-reported  information  from  facilities  may  open  incentives  to  gaming,  however, 
proponents  argue  that  gaming  the  MDS  reporting  system  would  be  too  difficult  because 
fraudulent  individuals  would  have  to  go  back  and  track  what  information  was  lied  about  earlier. 

A  second  question  is  how  to  integrate  incentives  to  improve  quality  of  life.  How  can  outcomes  be 
linked  to  payment?  Knatterud  commented  that  while  the  concept  of  linking  payment  to  outcome 
may  be  applicable  for  CQI  processes  or  baseline  care  issues,  advancements  in  establishing  quality 
of  life  standards  are  limited.  There  are  many  different  instruments  and  approaches,  not  just  one 
standard  tool  for  measuring  and  addressing  quality  of  life.  Therefore,  although  at  some  point  the 
workgroup  might  attempt  to  integrate  quality  of  life  measurement,  at  present  it  does  not  have  an 
appropriate  level  of  comfort  with  the  idea  of  using  quality  of  life  as  one  of  the  measurements  for 
incentive  payment.  When  Ms.  Gomez  was  asked  about  the  difficulty  in  working  to  improve 
quality  of  life  outcomes  using  MDS  information,  she  reported  that  the  State  may  use  quality  of  life 
satisfaction  surveys  for  family,  residents,  and  residents'  advocates,  or  perhaps  use  some  soft 
measures,  such  as  level  of  resident  involvement  in  the  community,  to  get  at  the  less-easily 
captured  quality  of  life  elements. 

A  third  point  noted  by  a  nursing  home  representative  on  the  workgroup  is  that  the  incentive  (5 
percent,  which  means  receiving  $105  instead  of  $100)  is  not  commensurate  with  the  level  of  effort 
that  would  go  into  the  improvements  required  to  receive  the  incentive  payment.  If  nursing  home 
administrators  or  owners  buy  into  the  concept  of  outcomes  measurement,  it  is  because  they 
believe  in  the  use  of  data  as  part  of  a  better  management  method  and  in  contract-based  purchasing 
(which  could  rely  heavily  on  demonstrable  outcomes)  as  the  coming  trend. 

12.6     Research  and  Research/Demonstrations 

Perhaps  for  incentive  payment,  the  most  relevant,  formative  years  to  date  have  been  1980  to 
1983.  From  1980  through  1983,  an  incentive  payment  experiment  (sponsored  by  the  National 
Center  for  Health  Services  Research  (NCHSR),  part  of  the  U.S.  Department  of  Health  and 
Human  Services)  designed  and  implemented  by  William  Weissert  was  in  operation.  In  December 
1983,  Robert  Kane  et  al.  released  research  entitled,  "Outcome-Based  Reimbursement  for  Nursing- 
Home  Care,"  which  had  also  been  supported  by  a  grant  from  NCHSR. 

12.6.1  Kane's  Work 

During  the  past  15  years,  Robert  Kane  probably  has  been  the  most  recognized  expert  supporting 
some  form  of  incentive  based  payment  for  nursing  home  care.  His  initial  empirical  work 
developed  and  tested  a  variety  of  data  instruments  and  summary  scales  derived  from  residents  in 
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four  Los  Angeles  nursing  homes.284  Scales  were  developed  to  reflect  domains  of  functioning 
within  the  nursing  home:  cognitive,  satisfaction,  affective,  activities  and  social  contact,  activities 
of  daily  living;  and  physical  conditions.  In  addition,  three  outcome  categories  were  developed  to 
capture  the  experience  of  those  who  left  the  nursing  home:  discharged  better  (to  the  community); 
discharged  worse  (usually  to  a  hospital);  and  dead. 

The  central  analysis  problem  was  to  determine  if  the  various  outcomes  were  predictable.  If  the 
outcomes  were  not  predictable,  then  it  would  hardly  seem  feasible  to  link  incentive  payment  to 
outcomes  that  seemed  random  or  unrelated  to  facility  care.  Moreover,  Kane  emphasized  the 
importance  of  not  just  determining  outcomes,  i.e.,  how  a  given  patient  does  over  time,  ".  .  .  but 
how  that  course  compares  to  what  can  be  realistically  [statistically  determined]  expected."  Given 
a  patient's  specific  conditions,  the  statistically  determined  expected  trajectory  may  be  a  decline  in 
functioning,  "Because  the  expected  course  of  many  people  receiving  long-term  care  is  gradual 
deterioration  in  many  sectors,  a  good  outcome  may  well  be  doing  better  than  expected,  i.e., 
slowing  the  rate  of  decline." 

In  general,  Kane  reported  good  prediction  for  changes  in  scale  scores,  with  much  better 
prediction,  not  surprisingly,  of  a  given  scale  if  the  prior  score  was  known.  There  was  little 
predictive  ability  on  the  basis  of  background  characteristics  only,  and  little  predictability  for  status 
changes,  i.e.,  discharged  better,  worse,  or  dead.  Finally,  Kane's  work  argued  that  it  may  be 
feasible  to  differentially  weigh  outcomes  on  the  basis  of  residents'  (and  their  families)  value 
preferences  as  to  the  importance  of  the  outcome  and  the  perceived  susceptibility  to  nursing  home 
intervention. 

This  earlier  empirical  work  argued  for  the  technical  feasibility  of  developing  a  comprehensive  set 
of  outcome  measures  that  could  be  linked  to  incentive  payments,  adjusted  for  risk  factors  and, 
perhaps,  for  value  preferences.  In  a  recent  paper,285  Kane  considered  a  number  of  other  issues 
with  outcome  based  reimbursement.  He  noted  that  ".  .  .a  cost-based  technique  (e.g.,  RUGS)  that 
tends  to  reward  deterioration  in  client  function,  when  that  deterioration  is  associated  with  the 
need  for  more  care,  would  be  in  direct  conflict  with  an  incentive  system  based  on  outcomes."286 
He  further  noted  that  "relying  exclusively  on  post-hoc  measures  of  outcomes  may  limit  regulatory 
programs  too  severely.  There  are  some  outcomes  that  should  be  prevented.  Waiting  to  respond 


Kane,  R.L.,  Bell,  R.M.,  Hosek,  S.D.,  Riegler,  S.Z.,  and  Kane,  R.A.  Outcome-Based  Reimbursement  for 
Nursing-Home  Care.  Prepared  for  the  National  Center  for  Health  Services  Research,  Department  of  Health 
and  Human  Services.  The  Rand  Corporation;  Santa  Monica,  CA.  December  1983. 

Kane,  R.L.  "Assuring  Quality  in  Nursing  Home  Care."  Paper  prepared  for  the  HCFA  Nursing  Facility  Quality 
Assessment  and  Assurance  Study,  presented  at  a  symposium  convened  by  HCFA  on  June  25-26,  1996,  in 
Baltimore,  MD. 

"RUGS"  is  an  acronym  for  resource  utilization  groups.  RUGS  are  used  to  categorize  nursing  home  residents  on 
the  basis  of  the  resources  that  they  are  supposed  to  use. 
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to  their  appearance  is  too  late.  For  example,  one  would  not  want  to  wait  for  a  nosocomial 
infection  before  assuring  that  adequate  infection  controls  were  in  place." 

Finally,  any  outcome-based  incentive  system  presents  an  enormous  data  collection  (and 
budgetary)  problem,  particularly  for  the  comprehensive  set  of  measures  proposed  by  Kane.  He 
proposes,  as  a  first  step,  to  adopt  the  MDS,  which  reasonably  covers  functioning.287  Although  he 
does  not  extensively  address  whether  the  data  are  adequate  for  this  limited  purpose,  he  does 
acknowledge  that  "any  operational  system  would  likely  require  some  method  for  randomly 
checking  the  assessment  results  to  assure  valid  responses.  But  this  validity  testing  would  be  much 
less  expensive  than  a  full  blown  primary  data  collection. 1,288 

Kane's  research  forms  an  important  backdrop  for  a  carefully  crafted  research  demonstration  to 
actually  test  incentive  payment,  the  San  Diego  experiment. 

12.6.2  The  San  Diego  Experiment 

The  San  Diego  experiment  used  financial  incentives: 

"...to  encourage  nursing  homes  to  admit  highly  dependent  Medicaid  residents  who  might 
otherwise  be  hospitalized  inappropriately,  improve  the  nature  of  the  care  provided  by  the 
nursing  home  by  setting  target  outcome  goals  for  specific  patients  and  by  establishing 
formal  treatment  plans  for  achieving  these  goals,  [and]  to  encourage  more  appropriate 
discharges  by  encouraging  institutions  to  provide  case-management  services,  and  by 
paying  additional  sums  in  situations  in  which  discharge  resulted  from  improved  care., 
including  improved  resident  outcomes."289 

Quite  relevant  to  this  report  is  the  second  of  the  three  goals  for  the  incentives,  to  improve  care  by 
setting  targeted  outcomes  for  residents  and  establishing  plans  to  reach  those  goals.  While  both 
the  State  systems  discussed  earlier  and  the  San  Diego  experiment  aimed  for  the  same  goal 


Kane's  "Assuring  Quality  in  Nursing  Home  Care"  paper  goes  on  to  say,  "A  second  step  would  be  to  create  two 
forms  of  the  MDS,  one  for  cognitively  intact  respondents  and  a  second  that  retams  the  current  approach  of 
external  rating.  The  interview  form  could  cover  many  of  the  missing  or  modestly  addressed  outcome  domains 
not  easily  accessible  in  the  current  MDS.''  During  recent  telephone  discussion  with  Kane,  he  reiterated  this 
idea. 

HCFA  has  a  small  current  project  to  develop  an  offsite  editing  tool  that  might  identify  MDS  assessments  and 
data  elements  that  are  in  error.  At  this  point,  the  adequacy  of  this  tool  and  the  degree  to  which  it  can  reduce  the 
need  for  onsite,  primary  data  collection  is  unknown. 

Thorburn,  P,  and  Meiners,  M.R.  Nursing  Home  Patient  outcomes:  the  Results  of  an  Incentive  Reimbursement 
Experiment,  Long-Term  Care  Studies  Program  Research  Report,  DHHS  Publication  No.  (PHS)  86-3400.  U.S. 
Department  of  Health  and  Human  Services,  National  center  for  Health  Serv  ices  Research  and  Health  Care 
Technology  Assessment,  March  1986,  p.  2. 
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(namely,  improved  care  for  residents),  the  San  Diego  experiment  had  one  significant  difference. 
State  systems  have  tended  to  look  at  process  or  structural  criteria,  which  inadvertently  may 
contribute  to  a  paper  rather  than  a  resident  focus.  The  San  Diego  experiment,  however,  looked 
directly  at  residents'  outcomes. 

Reported  results  of  this  experiment  vary  widely.  The  evaluation  conducted  by  Phyllis  Thorburn 
and  Mark  Meiners  for  NCHSR  in  the  mid  1980s  found  no  evidence  that  goal-related 
reimbursement  incentives  improved  patient  outcomes.290  However,  Thorburn  and  Meiners'  report 
discussed  possible  explanations  for  this  finding  and  did  not  discount  the  idea  of  incentive  payment 
altogether.  In  more  recent  years,  the  no-impact  conclusion  has  been  challenged  by  Edward 
Norton.  In  1991,  Norton  utilized  a  different  statistical  analysis  method  for  evaluation  of  the  data 
and  found  that  the  incentive  payments  had  highly  favorable  effects  on  all  three  of  the  targeted 
goals.  In  spite  of  Norton's  glowing  review  of  the  San  Diego  experiment,  other  long-term  care 
researchers  (with  the  notable  exception  of  William  Weissert,  the  experiment's  designer)  still  tend 
to  categorize  the  experiment  as  a  failure.  As  this  research  project  is  the  best  documented  and  the 
most  relevant  to  a  discussion  of  the  possibility  of  linking  quality  outcomes  to  incentive  payment, 
the  San  Diego  experiment  merits  closer  inspection. 

12.6.2.1  Background 

Designed  by  William  Weissert,  the  experiment  was  conducted  in  36  proprietary  nursing  homes  in 
the  San  Diego,  California,  area  for  a  30  month  period  between  1980  and  1983.  The  experiment 
not  only  sought  to  promote  improved  access,  care,  and  appropriate  discharge,  it  also  was  aimed  at 
cost  containment.  By  freeing  nursing  home  beds  inappropriately  occupied  by  people  who  could 
have  been  discharged,  heavier  care  beneficiaries  who  were  being  held  at  the  hospital  for  their  care 
needs  could  be  relocated  to  the  nursing  home  environment,  thus  reducing  cost.  In  a  1983  article 
in  the  Health  Care  Financing  Review ,  Weissert  et  al.  cited  studies  that  found  that  between  one 
and  seven  million  hospital  days  per  year  were  being  used  for  people  awaiting  nursing  home 
placement.291   In  recent  communication,  Dr.  Weissert  explained  that  the  San  Diego  experiment 
also  addressed  several  program  reimbursement  weaknesses;  specifically,  that  if  payment  for 
special  services  for  residents  is  lumped  into  the  general  payment  for  nursing  home  resident  care, 
the  money  is  taken  without  services  being  obtained.  If  the  payment  is  based  on  use,  treatments 
are  given  to  everyone,  regardless  of  appropriateness,  to  obtain  the  extra  payment.  The  payment 
mechanism  needs  to  have  a  way  of  ensuring  that  services  provided  for  are  actually  rendered.292 


Ibid,  p  9. 

Weissert,  W.G.,  Scanlon,  W.J.,  Wan,  T.T.H.,  and  Skinner.  D.E.  Care  for  the  chronically  ill:  Nursing  home 
incentive  payment  experiment.  Health  Care  Financing  Review.  Vol.  5.  No.  2.  Winter  1983.  p  42. 

Personal  communication;  October  10,  1997. 
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The  1983  article  explained  that,  "Outcome  incentive  payments  would  be  paid  for  achieving 
specified  outcome  goals  in  selected  patients  who  require  special  care  to  improve  or  maintain  their 
functional  or  health  status.  If  a  patient  requires  several  types  of  special  care,  payments  would  be 
made  for  each  outcome  achieved.  Payment  would  be  conditional  upon  success  in  achieving  the 
outcome."293  Six  outcome  goals  were  established,  including:  the  remission  or  elimination  of 
certain  decubitus  ulcers;  elimination  of  the  need  for  tube  feeding  for  dependent  residents; 
maintenance  of  good  skin  condition  in  comatose  residents,  improved  activities  of  daily  living 
(ADL)  functioning  needed  to  move  toward  resident  discharge,  improved  ADL  ratings,  and 
maintenance  of  ADL  functioning  if  the  resident  underwent  a  reversible  change  in  health  status 
associated  with  an  acute  episode  which  might  have  resulted  in  the  decline  of  ADL  abilities.294 
Residents  were  nominated  for  participation  by  the  nursing  homes'  staff.  If  a  research  team  nurse 
agreed  that  the  resident  suffered  from  one  of  the  specific  conditions  for  which  outcome  goals 
were  offered,  and  improvement  could  not  be  achieved  without  special  effort  beyond  standard 
nursing  care,  then  the  nomination  was  approved  and  the  nursing  home  had  the  opportunity  to  earn 
the  outcome  incentive  payment  for  that  resident.  If  the  goals  were  achieved,  the  facility  received 
payment  at  the  end  of  the  calendar  quarter  in  which  the  goal  was  set  and  achieved. 

This  experiment  was  in  some  respects  less  ambitious  than  the  approach  advocated  by  Kane.  The 
range  of  outcome  conditions  were  very  specific  and  applied  only  to  a  minority  of  nursing  home 
residents.  About  one  third  of  patients  in  the  experimental  and  control  facilities  were  eligible  for  at 
least  one  outcome  goal,  and  only  about  one  third  of  these  were  nominated  for  an  outcome  goal. 
Additionally,  this  carefully  crafted  experiment  had  a  number  of  elements  that  should  be  noted: 

•  All  but  4  of  the  40  proprietary  SNF's  in  San  Diego  agreed  to  participate,  and  "the  four 
nonparticipating  facilities  were  homes  with  very  few  Medicaid  patients."  Given  that  this 
was  an  experiment  in  Medicaid  reimbursement,  the  four  nonparticipating  facilities  with 
few  Medicaid  patients  should  not  be  a  threat  to  the  external  validity  of  the  results  as 
applied  to  the  facilities  with  significant  numbers  of  Medicaid  patients.  The  36 
participating  facilities  were  randomly  assigned  to  treatment  and  control  groups.  Although 
about  one  third  of  the  Medicaid  residents  in  both  treatment  and  experimental  facilities  did 
not  consent  to  participating,  there  was  no  evidence  presented  that  this  introduced  any 
selection  bias. 

•  The  incentive  payments  for  selected  conditions  were  paid  in  addition  to  the  normal 
Medicaid  reimbursement.  The  rationale  for  this  procedure  is  that  these  payments  were  for 
conditions  that  the  SNF  staff  and  the  research  team  nurse  thought  improvement  could  not 
be  achieved  "without  special  effort  well  beyond  ordinary  good  nursing  care."   It  should  be 
noted,  however,  that  the  normal  Medicaid  reimbursement  rate  in  California  at  the  time  of 


Weissert  et  al,  p  43. 
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the  study  (1981)  was  a  flat  rate  of  $36.  In  contrast  to  case-mix  adjusted  payment  systems, 
flat-rate  systems  are  generally  viewed  as  providing  a  low  rate,  and  do  not  encourage  the 
admission  or  treatment  of  patients  with  special  care  needs.  Hence,  one  could  argue  that 
even  if  positive  outcomes  are  achieved  with  incentive  payments  provided  within  the 
umbrella  of  a  flat-rate  system,  these  results  might  not  occur  in  the  majority  of  non-flat  rate 
payment  States. 

The  amount  of  the  incentive  payment  was  derived  from  a  separate  time  and  motion  Nurse 
Observation  substudy  of  the  resources  needed  for  the  special  care  required  for  each 
condition.   Finally,  "the  payment  rates  were  adjusted  so  that  a  successful  outcome  earned 
a  facility  twice  the  estimated  cost  of  achieving  the  goal.  This  was  done  to  compensate  for 
a  possible  error  rate  of  50  percent  in  estimating  patient  outcomes."295  All  of  the  above 
features  of  the  incentive  payment  setting  were  to  ensure  that  the  payment  was  fully 
commensurate  with  the  cost  of  providing  the  special  services  required  and  the  risk  that 
even  with  the  best  efforts,  improvement  is  not  always  assured 

•  The  design  of  the  intervention  had  a  number  of  features  to  prevent  gaming  of  the  payment 
incentive:  "...a  research  team  nurse  reviewed  each  goal  [of  nominated  residents]  to 
confirm  that  the  patient  met  the  eligibility  criteria  for  the  goal  and  that  there  was  a 
reasonable  chance  of  achievement.  If  so,  the  goal  was  approved.  Ninety  days  later,  the 
research  team  nurses  reassessed  the  patient's  condition  to  determine  whether  the  goal  had 
been  achieved." 

•  The  internal  validity  of  many  social  experiments  are  threatened  by  the  knowledge  of  the 
treatment  group  that  they  are  participating  in  a  demonstration.  Most  generally,  a 
Hawthorne  effect  might  occur  when  treatment  facilities  perform  (initially)  better  than  they 
would  otherwise.  Also,  in  payment  demonstrations  there  is  always  the  possibility  that 
facilities  will  drop  out  of  the  demonstration  when  they  feel  it  offers  no  advantage.  This 
did  not  occur,  perhaps  due  to  a  number  of  efforts  to  ensure  their  cooperation. 
Specifically,  the  experiment  lasted  30  months  with  incentive  payments  continuing  beyond 
that  period  to  ensure  that  patients  admitted  during  the  demonstration  would  not  be 
subsequently  discharged  after  the  study  ended. 

Randomization,  incentive  payments  sufficient  to  cover  costs  and  risks,  independent  assessment  of 
subject  eligibility  and  achievement  of  goals,  and  sufficient  duration  to  approximate  "real  life" 
rather  than  "demonstration"  conditions  (and  apparently  no  attrition)  all  combine  to  create  an 
unusually  strong  research  demonstration.   In  short,  this  is  about  as  good  as  it  gets.   Although  it 


The  flat-rate  in  1 98 1  was  $36  per  day  or  a  total  pavment  of  $3240  for  a  90  day  period.  The  bonus  payment  for 
improved  outcome  ranged  between  $126  to  $370  per  case  if  the  goal  was  achieved,  i.e.,  a  bonus  of  about  4-11 
percent.  Clearly,  this  is  a  substantial  incentive. 
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is  always  best  to  replicate  studies,  if  positive  outcomes  cannot  be  achieved  under  these  conditions, 
it  is  doubtful  that  incentive  payments  work  as  intended. 

12. 6. 2. 2     Thorburn  and  Meiners '  Conclusion 

Thorburn  and  Meiners,  the  authors  of  the  NCHSR  report,  stated: 

"On  the  basis  of  this  experiment,  there  is  no  evidence  that  goal-related  reimbursement 
incentives  improve  patient  outcomes...  The  goal-achievement  rate  was  low  in  absolute 
terms  and  was  no  greater  than  the  achievement  rate  in  the  control  facilities,  which  did  not 
receive  any  reimbursement  apart  from  the  standard  Medicaid  rate."296 

The  discussion  section  of  the  report  noted  that  only  limited  training  was  provided  at  the  start  of 
the  project.  "The  nursing  homes  were  mostly  left  to  work  out  for  themselves  how  to  rehabilitate 
the  patients  to  achieve  these  goals,  and  to  master  the  process  of  care  planning  for  these  particular 
outcome  goals.  Provision  of  formal  training  or  specific  guidance  in  achieve  patient  goals  was  not 
part  of  the  intervention."297 

Thorburn  and  Meiners  observed  that  the  experimental  element  of  the  system  complicated  matters. 
The  experiment  ran  for  30  months,  the  first  6  of  which  were  used  to  obtain  baseline  information 
on  residents,  the  participating  facilities,  and  methods  of  operation,  so,  in  effect,  the  system  was  in 
place  for  2  years.  The  Thorburn  and  Meiners  report  theorized  that  the  changes  needed  to  achieve 
the  ends  sought  by  the  experiment  would  have  required  a  certain  change  of  culture.  Leadership 
buy-in  and  training  for  staff  in  new  or  underutilized  approaches  would  have  been  necessary  for  the 
transition  to  be  successful.  Had  the  conditions  of  the  experiment  been  permanent  and  widespread, 
encouraging  these  staff  and  facility  changes  might  have  been  more  successful,  the  report 
posited.298  The  experimental  period  may  have  seemed  too  brief  to  facilities  to  justify  the  level  of 
change  needed  to  earn  the  incentives  and  achieve  the  desired  outcomes  A  stronger  intervention, 
where  economic  incentives  were  supplemented  by  training,  might  also  have  been  more  successful. 

"Probably,  a  range  of  tools  is  needed  to  bring  about  a  reorientation  of  nursing  homes  to 
more  rehabilitative  care.  Financial  incentives  may  prove  to  be  one  of  those  tools.  But 
education  and  training  of  staff,  including  nurse  aides,  in  techniques  for  rehabilitating 
patients,  care  planning,  and  related  aspects  of  patient  care  may  have  a  role.  There  also  may 
be  a  need  to  train  nursing  home  administrators  or  directors  of  nursing  in  methods  of 


Thorburn  and  Meiners,  p  10. 
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providing  incentives  to  the  lower-level  staff  members  who  provide  the  bulk  of  direct 
patient  care."299 

The  report  noted  that  the  improvement  goals  linked  to  incentives  were  made  for  a  minority  of  the 
patients  (partially  because  patient  consent  was  required  to  be  included  in  the  experiment).  If  this 
system  were  to  replace  regulatory  intervention,  improvement  goals  would  need  to  be  set  for  all 
residents.  Additionally,  the  report  noted,  "Incentive  payment  may  still  prove  effective  if  it  is 
limited  to  certain  clearly  delineated  conditions.  In  this  event  it  could  supplement  rather  than 
replace  other  approaches  to  quality  assurance  in  nursing  homes."300 

In  an  article  that  appeared  in  The  Journal  of  Health  Politics,  Policy  and  Law,  Jacqueline  Zinn 
made  a  similar  observation,  noting  that: 

"While  research  evidence  is  inconclusive,  it  does  offer  some  promise  for  quality-  or 
outcomes-based  payment  incentives...  While  there  was  no  evidence  overall  [from  the  San 
Diego  experiment]  that  payment  incentives  enhanced  goal  achievement,  goals  related  to 
clearly  defined  conditions  or  practices,  such  as  tube  feeding,  emerged  as  the  ones  most 
likely  to  be  achieved."301 

Even  the  less  positive  review  of  the  San  Diego  experiment  allowed  that  an  incentive  payment 
system  may  have  an  effective  application  as  part  of  a  permanent  system. 

J  2. 6. 2. 3    Norton 's  Conclusion 

In  1992,  an  article  by  Norton  in  the  Journal  of  Health  Economics  challenged  the  Thorburn  and 
Meiners  assertion  that  the  incentive  payment  had  not  effectuated  increased  quality  outcomes  for 
residents.  Norton  stated  that  by  using  a  Markov  model  to  represent  the  resulting  health  changes 
of  nursing  home  residents  in  analysis  of  the  incentive  payment  system,  "the  incentive  regulation  of 
nursing  homes  was  found  to  have  had  beneficial  effects  on  access,  quality,  and  cost  of  care."302 
More  people  with  heavier  care  needs  were  admitted,  functional  and  health  status  was  improved, 
the  average  length  of  stay  was  shortened  (i.e.,  more  people  were  transferred  to  their  home  or  a 
lower  level  of  care),  and  fewer  died  or  were  hospitalized. 


Ibid. 
Ibid. 
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Why  such  dramatic  differences  in  the  conclusions  by  different  investigators,  presumably  derived 
from  the  same  data?  Although  this  report  has  focused  on  whether  the  San  Diego  experiment 
improved  resident  outcomes,  it  will  be  recalled  that  the  intervention  also  had  incentives  for 
admissions  and  discharges.303  Norton  pointed  out  that  in  the  original  evaluation  of  Meiners, 
Thorburn,  Roddy,  and  Jones,  descriptive  statistics  alone  had  been  used,  and  the  effect  of  each 
incentive  had  been  examined  in  isolation.  The  key  thrust  of  Norton's  argument  was  that  the  three 
incentives  of  this  intervention  were  not  independent,  and  "since  the  effects  of  the  incentives  on 
nursing  home  behavior  are  interrelated,  they  cannot  be  modeled  separately." 

In  response  to  this  analysis  problem,  he  proposed  using  the  Markov  model,  which  "exploits  the 
unique  features  of  the  data  which  are  that  the  residents'  health  was  tracked  throughout  their  stay 
in  a  nursing  home  and  the  time  between  observation  is  known."  While  the  Markov  model  itself 
maintains  several  strong  assumptions  that  we  need  not  concern  ourselves  with  here,  we  think  the 
general  approach  of  assessing  all  three  incentives  simultaneously  is  correct.  Weissert  also  supports 
the  use  of  the  Markov  model  for  evaluation  of  the  San  Diego  experiment  and  feels  that  it  is 
conceptually  right  to  put  all  three  incentives  together  in  measuring  the  effectiveness  of  the 
project.304 

Norton's  analysis  found  that: 

"In  terms  of  cost,  if  this  program  were  implemented  by  the  government,  Medicaid  would 
save  roughly  20%  per  stay  because  of  shorter  stays.  However,  as  long  as  nursing  home 
occupancy  rates  remained  high,  total  Medicaid  costs  would  increase  around  5%  because 
of  the  greater  variety  of  patients  and  the  additional  payment  incentives.  By  the  same 
token,  this  system  would  provide  savings  through  lower  hospitalization,  by  freeing  up  beds 
from  the  shorter  length  of  stay,  and  reducing  excess  demand  for  Medicaid  patients."305 

While  this  argument  seems  quite  strong,  it  is  important  to  recognize  the  change  in  environment 
since  1983.  Nursing  homes  occupancy  rates  have  been  steadily  declining,  the  number  of  homes 
has  grown  significantly,  and  the  problem  of  people  being  inappropriately  hospitalized  may  have 
been  address  by  changes  to  hospital  reimbursement  made  since  1983.  Perhaps  even  more 
importantly,  most  nursing  homes  are  not  paid  under  flat-rate  systems,  as  was  the  case  in  California 
in  1981-1983.  About  half  of  all  States  are  employing  some  form  of  case-mix  adjusted 
reimbursement,  a  system  which  is  intended  to  encourage  some  of  the  same  quality  objectives  as 
incentive  payments.  In  short,  incentive  payments  may  not  have  the  same  positive  effects  under 


Meiners  et  al.  did  find  small  positive  effects  on  admission  and  essentially  no  positive  effects  on  outcomes  or 
discharges. 

Personal  communication;  October  10,  1997. 
Norton,  p  108. 
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Medicaid  case-mix  payment  as  was  observed  by  Norton  under  a  flat-rate  system.  Indeed,  as  was 
noted  in  the  discussion  of  the  work  of  Kane,  some  kinds  of  case-mix  payment  systems  may  be  in 
direct  conflict  with  incentive  payment.  Additionally,  with  the  implementation  of  OBRA  '87  and 
the  diffusion  of  geriatric  knowledge  and  practice,  the  normal  level  of  care  in  nursing  homes  may 
have  improved  in  the  absence  of  incentive  payments  (as  discussed  in  other  sections  of  this  report). 
For  all  these  reasons,  the  argument  for  improved  resident  outcomes  as  well  as  potential  saving  for 
the  Medicaid  program  may  no  longer  be  valid. 

All  of  the  above  issues  notwithstanding,  we  have  found  no  claim  that  there  is  currently  an 
incentive  system  available  that  could  taken  "off  the  shelf  and  implemented  tomorrow.  The 
incentive  payment  advocates  recognize  that  the  introduction  of  an  incentives  system  would  need 
to  be  predicated  on  a  demonstration  in  the  current  environment. 

The  success  of  the  San  Diego  experiment  has  been  argued,  several  points,  however,  stand.  First, 
the  experiment  was  ahead  of  its  time.  It  was  one  of  only  two  well-documented,  published 
attempts  to  link  incentive  payment  directly  to  measured  resident  outcomes  rather  than  process  or 
structural  requirements.  Even  the  report  that  judged  the  experiment's  impact  less  favorably  did 
not  discount  a  possibility  of  practical  applications  for  such  a  system.  Its  designer,  Weissert,  still 
believes  that  the  system  used  in  San  Diego  could  be  applied,  and  is  interested  in  conducting 
research  on  further  development  and  a  demonstration  in  the  current  environment.  Although  the 
San  Diego  incentives  system  is  not  ready  to  pull  off  the  shelf  and  operate  at  this  instant,  it  is 
possible  that  a  reincarnation  of  it  will  reappear  in  Weissert's  future  work. 

12.7  Issues 

12.7.1  Conceptual 

The  fundamental  concept  of  incentives,  particularly  incentive  payments,  seems  simple.  However, 
after  discussion,  it  becomes  apparent  that  there  are  as  many  permutations  of  what  this  phrase 
might  mean  as  there  are  people  to  talk  to  about  it.  Even  if  one  can  set  up  definite  boundaries  for 
the  meaning  of  the  term,  each  person  has  a  slightly,  if  not  radically,  different  perception  of  how  an 
incentives  system  would  be  translated  from  theory  to  practice.  Incentive  payments  could  be 
introduced  in  a  number  of  ways.  Incentive  payment  could  replace  the  current  reimbursement 
structure  with  its  own  methods  for  calculating  payment,  awarding  higher  amounts  for  those 
facilities  able  to  achieve  care  and  outcome  goals  and  withholding  money  from  those  who  failed  to 
achieve  those  goals.  Or,  incentive  payments  could  be  a  bonus  earned  in  addition  to  standard 
reimbursement.  Incentive  payment  could  be  based  on  the  number  of  Medicare  and  Medicaid 
recipients  in  the  facility,  or  only  on  the  number  of  residents  for  whom  certain  measurable 
outcomes  could  be  set  and  achieved.  Some  also  consider  withholding  part  of  the  current  standard 
payment  and  making  providers  earn  that  part  by  achieving  cenain  goals  to  be  an  incentives 
system. 


Study  of  Private  Accreditation  (Deeming)  of  Nursing  Homes,  333 
Regulatory  Incentives  and  Non-Regulatory  Initiatives,  and 
Effectiveness  of  the  Survev  and  Certification  Svstem 


Past  incentives  systems  were  introduced  to  encourage  certain  behaviors  or  changes.  Generally, 
these  changes  were  thought  of  mechanisms  that  would  promote  quality  of  care  and  life,  equal 
access  to  nursing  home  care,  and  more  efficient  management  of  Medicaid  funds  (by  ensuring 
appropriate  admission,  treatment,  and  discharge).  Each  incentives  system  has  been  an  entire 
strategy  in  and  of  itself,  making  it  difficult  to  conduct  a  discussion  of  incentives  without  pulling  in 
many  peripheral  issues. 

12.7.2  Fiscal 

One  interviewee  argued  emphatically  that  incentive  payment  cannot  work  in  a  cost-based 
environment;  a  fee-based  or  capitated  reimbursement  system  would  be  necessary.  In  a  cost-based 
system,  if  the  incentive  payment  awarded  is  put  back  into  basic  costs  of  operation  (such  as 
increasing  the  number  of  aides  or  the  level  of  qualification  of  the  nursing  home  staff),  that  increase 
of  spending  shows  up  in  the  next  cost  report.  Such  a  system  is  inflationary. 

As  touched  upon  earlier,  Medicaid  payment  systems  vary  widely  in  structure  and  operation  from 
State  to  State.  Setting  up  the  environment  described  in  the  previous  paragraph  might  require 
significant  restructuring  of  Medicare  and  Medicaid  payment  systems. 

In  addition  to  concerns  about  a  possible  inflationary  effect  on  basic  costs,  a  fundamental  issue  is 
the  source  of  incentives  funding.  With  two  exceptions,  an  incentives  system  is  not  budget  neutral. 
These  exceptions  are  the  model  within  which  a  part  of  standard  payment  is  withheld  pending 
achievement  of  goals  and  Kane's  1983  approach  in  which  payments  to  facilities  which  do  not 
achieve  outcome  goals  are  reduced,  thus  offsetting  the  additional  payment  to  those  facilities 
performing  well. 

The  cost  of  funding  the  incentive  payments  themselves  is  not  the  only  financial  component  to 
consider.  Monitoring  and  administering  an  incentives  system  would  require  resources.  In  Kane's 
1983  discussion  of  this  issue,  he  suggests  diverting  funds  from  existing  survey  and  certification 
functions  (which  he  argues  are  not  effective  in  guaranteeing  quality  of  care  and  life)  to  the 
necessary  monitoring  efforts.  Given  that  at  present  there  is  no  proposed  incentives  system  or 
monitoring  mechanism  on  the  table,  estimates  of  cost  and  discussions  about  reallocating  a  portion 
of  survey  and  certification  funds  are  premature.  However,  this  suggestion  points  to  another 
interesting  aspect  of  incentives,  namely,  how  they  relate  to  the  existing  regulatory  framework. 

12.7.3  Integration  with  Regulations 

How  does  an  incentives  system  mesh  with  current  regulatory  requirements9  Would  such  a  system 
entirely  supplant  the  current  regulatory  requirements,  which  are  criticized  as  failing  to  measure 
less  tangible  quality  of  care  and  the  quality  of  life  components  of  residents'  lives? 
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This  is  perhaps  the  only  point  that  has  some  level  of  agreement.  In  personal  communication, 
interviewees  typically  did  not  envision  an  incentives  system  operating  in  complete  independence 
of  regulatory  standards.  Charlene  Harrington  suggested  that  for  an  incentives  system  to  operate 
safely,  the  government  would  need  to  have  tough  regulations  in  place  with  enforced  requirements 
and  penalties  for  failure  to  meet  minimum  standards  of  performance.  Without  this  component,  an 
incentives  system  that  rewards  providers  who  are  already  good,  already  doing  what  they  are 
supposed  to,  is  dangerous. 

Kane  suggested  cutting  back  on  the  regulations  judiciously,  keeping  the  ones  that  deal  with  clear 
cut  issues  such  as  the  life  safety  code  and  infection  control.  The  current  quality  of  care  and  life 
regulations,  however,  fail  to  get  at  relevant  issues.  The  regulatory  model  for  measuring  and 
ensuring  quality  of  care  and  life  in  nursing  homes  has  been  "disastrous."  Basically,  he  noted, 
regulations  provide  a  yes/no  measurement  of  performance.  Either  a  facility  meets  a  standard,  or  it 
does  sot.  Regulations  do  not  help  with  quality  assurance.  A  system  with  outcomes-based 
incentives  is  desirable  because  it  could  do  what  the  regulatory  model  wants  to  do;  pick  out  the 
"bad  apples"  and  raise  the  bar  of  performance.  An  incentives-based  system  could  put  the  poor 
performers  out  of  business  by  reducing  payment  to  them.  "There's  no  need  to  reward  people  for 
doing  a  bad  job,"  Kane  emphasized.  Often,  the  regulatory  system  does  just  that  by  pouring 
money  into  assistance  and  training  for  such  facilities  and  paying  them  and  the  facilities  that  are 
doing  a  good  job  at  the  same  level. 

Weissert  pointed  out  the  need  for  a  mechanism  to  look  at  and  deal  with  facilities  that  are  content 
to  provide  minimal  care  and  receive  the  basic  payment.  Weissert  suggested  a  set  of  positive 
incentives  and  negative  constraints.  At  this  point,  he  has  not  considered  which  regulations  could 
be  done  away  if  incentives  linked  to  quality  were  phased  in.  Analysis  would  be  needed  to 
consider  the  potential  impact  and  possible  side  effects  of  removing  certain  regulations. 

12.7.4  Implementation 

Aside  from  conceptual  differences  and  funding,  another  thorny  issue  is  how  to  operationalize  an 
incentives  system.  How  is  the  incentive  earned?  In  the  past,  incentive  payment  has  been  awarded 
based  on  compliance  with  regulatory  requirements,  independently-developed  criteria  (process  and 
structure  requirements),  and  observed  outcomes.  Although  some  suggest  using  the  MDS  to 
benchmark  residents'  conditions  and  track  improvement,  critics  argue  that  both  the  MDS  and 
current  regulations  are  crude  instruments  for  measuring  quality  of  care  and  life.  Additionally,  one 
must  consider  issues  such  as  the  reliability  of  the  data  recorded  on  the  MDS  and  its  susceptibility 
to  being  rigged. 

A  number  of  leading  researchers  remarked  on  the  difficulty  of  forming  an  incentives  system. 
Harrington  stated,  "Technically  linking  payment  to  improved  quality  is  difficult,  and  a  lot  of 
people  object  to  it  conceptually."  National  payment  systems  expert  Barbara  Manard  added,  "I 
think  it  [incentive  payment]  stinks,"describing  the  technical  problems  in  trying  to  structure  and 
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operationalize  a  system  that  supports  its  use.  Contributing  to  the  problem  is  the  difficulty  of 
assessing  less  concrete  areas,  such  as  quality  of  life.  There  is  no  standard  instrument  for  quality  of 
life  measurement.  Additionally,  another  commenter  noted,  psychosocial,  mental,  and  physical 
factors  are  all  intertwined  and  cannot  be  separated;  how  can  a  home  be  held  responsible  for 
physical  decline  in  an  individual  that  is  due  to  a  depression  that  pre-dates  nursing  home 
admission?  How  can  the  factors  be  separated  out  and  blame  be  laid  upon  the  home  for  things 
beyond  its  control?  Interestingly,  Manard  noted,  "We  can't  do  risk  analysis  very  well." 
Determining  the  nursing  home's  contribution  to  outcome  versus  what  is  due  to  the  conditions  that 
people  arrive  with  is  difficult. 

If  incentive  payment  is  based  on  a  graduated  or  assigned  rating,  regulators  may  face  an 
administrative  nightmare  if  facilities  receive  anything  less  than  the  optimum  rating.  An  effective 
incentives  system  would  need  to  differentiate  between  levels  of  performance,  which  would  again 
call  irtto  question  how  sophisticated  methods  for  risk  adjustment  are.  Depending  on  which  of  the 
reimbursement  systems  one  places  incentive  payments  within,  quite  a  bit  could  be  riding  on 
receipt  of  a  certain  rating.  Accordingly,  it  is  not  a  leap  to  judge  that  industry  would  request  some 
sort  of  appeals  system,  and,  in  the  absence  of  such  a  system,  might  seek  court  settlement  for 
disputes. 

While  the  current  lack  of  a  definitive  implementation  plan  for  incentives  does  not  reduce  the 
concept's  possible  promise,  it  does  indicate  that  a  lot  of  groundwork  would  be  necessary  before 
such  a  system  could  be  implemented. 

12.7.5  Philosophical 

On  a  fundamental  level,  there  is  a  lack  of  agreement  about  the  appropriateness  of  incentive 
payment.  Several  interviewees  feared  that  if  the  incentive  payment  system  had  a  capacity  for 
withholding  money  for  poor  performance,  its  effect  would  be  to  make  bad  homes  worse, 
contributing  to  a  downward  spiral  in  care.  Although  a  proponent  of  this  idea  could  argue  that 
withholding  money  for  poor  performance  would  drive  those  facilities  that  are  inferior  out  of 
business  and  thereby  improve  care,  there  is  still  the  concern  that  in  some  States  bed  shortage 
continues  to  be  a  factor.  If  providing  good  care  was  seen  as  lucrative,  however,  perhaps  good 
providers  would  expand  and  overtake  competitors.  Obviously,  arguments  can  be  made  for  either 
line  of  thought. 

Interviewees  who  objected  philosophically  to  incentive  payment  commented  that  there  are  cheap 
homes  that  give  excellent  care  and  are  conscientious  about  promoting  quality  of  life,  and 
expensive  ones  that  do  neither.  They  cited  a  lack  of  research  for  substantiating  claims  that  a 
financial  incentive  would  necessarily  improve  conditions  in  homes.  Giving  facilities  more  money 
is  not  necessarily  a  step  that  will  increase  quality;  perhaps  all  that  would  be  accomplished  is 
handing  over  more  money  to  facilities  that  are  already  performing  well. 
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Incentives  systems  have  a  number  of  advocates  and  well-wishers,  however.  Researcher  Catherine 
Hawes  stated  that  conceptually,  she  likes  the  idea,  although  it  probably  would  be  an 
administrative  nightmare.  Working  out  the  details  of  what  desirable  and  achievable  outcomes  are 
would  be  challenging  as  well. 

12.8  Next  Steps 

Researchers'  and  regulators'  opinions  about  the  possibilities  of  an  incentives  system  range. 
Incentive  payment  has  its  advocates  and  its  critics.  Research  about  incentive  payments  has  not 
been  firmly  supportive  or  negative.  Researchers  were  asked  what  needs  to  happen  to  move  ahead 
with  incentive  payments. 

Harrington  suggested  that  the  first  step  in  pursuing  an  incentive  payment  system  would  be  to  start 
with  a  fresh  RFP  for  demonstrations,  since  there  is  no  general  belief  that  there  is  anything 
effective  in  existence  currently.  Kane  concurred  with  this  observation  and  suggested  research  to 
determine  how  facilities  would  react  to  certain  incentives.  There  is  discussion  about  whether 
incentive  payments  or  marketability  and  recognition  constitute  better  motivation.  Trying 
economic  incentives,  he  stated,  would  be  a  good  idea  because  people  respond  to  money.  An 
incentive  payment  demonstration  would  take  about  3  to  5  years,  with  2  years  to  get  it  up  and 
running,  Kane  noted. 

Weissert  took  a  more  positive  view  of  where  incentive  payment  is.  When  asked  about  the 
existence  of  a  workable  national  incentive  payment  system,  he  suggested  the  one  used  for  the  San 
Diego  experiment.  He  noted  that  an  incentive  payment  system  would  need  to  be  tried  out 
experimentally  prior  to  nationwide  implementation,  however. 

12.9  Conclusion 

Incentives  systems  are  conceptually  appealing  and  may  have  promise.  Certainly,  incentive 
payment  has  proponents.  It  is  unusual  that  an  idea  with  so  much  appeal  has  not  been  more  fully 
developed  and  operationalized  during  the  more  than  17  years  in  which  it  has  been  considered  and 
discussed.  Perhaps  this  is  evidence  that  concerns  about  the  technical  difficulty  of  implementing 
such  a  system  are  warranted.  Arguably,  there  are  other  factors  that  may  have  also  hindered 
development,  such  as  the  inconclusive  findings  of  the  NCHSR  reports. 

A  focused  consideration  of  incentive  payment's  merits  is  difficult  as  the  concept  is  enmeshed  in 
issues  such  as  reimbursement,  access,  and  quality  measurement,  all  three  being  challenging  areas 
where  industry,  government,  consumers,  and  researchers  have  not  been  able  to  come  to  consensus 
on  how  best  to  proceed.  Furthermore,  the  most  relevant  information  available  is  dated.  To 
determine  the  merit  of  this  concept,  a  research  demonstration  is  needed  in  the  current 
environment. 
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13.0     REVIEW  OF  NON-REGULATORY  INITIATIVES  FOR  QUALITY 
IMPROVEMENT 


13.1     Regulatory  Background 

As  the  primary  payor  for  nursing  home  care  in  the  United  States,  HCFA  has  the  responsibility  to 
act  as  a  "prudent  purchaser"  by  ensuring  that  the  skilled  nursing  facilities  and  nursing  facilities 
participating  in  Medicare  and/or  Medicaid  meet  certain  threshold  requirements  for  quality, 
environment,  and  services.  These  requirements  are  found  at  42  Code  of  Federal  Regulations 
(CFR)  Part  483,  Subpart  B.  The  Omnibus  Budget  Reconciliation  Act  of  1987  (OBRA  '87),  P  L 
100-203,  as  amended  in  1988,  1989,  and  1990,  changed  these  requirements  by  introducing  an 
increased  focus  on  quality  of  life  and  quality  of  care,  the  importance  of  the  individual  resident,  and 
the  need  to  help  him/her  to  reach  his  "highest  practicable  level"  of  functioning. 

To  promote  improved  quality  of  care  and  life  for  nursing  home  residents,  OBRA  '87  (and, 
consequently,  the  Social  Security  Act  (the  Act)  and  regulations)  introduced  requirements  related 
to  a  quality  assurance  function  for  facilities.  Sections  1819(b)(1)(B)  and  1919(b)(1)(B)  of  the  Act 
and  42  CFR  483  .75(o)  require  that  each  facility  maintain  a  quality  assessment  and  assurance 
committee  consisting  of  the  director  of  nursing  services,  a  physician  designated  by  the  facility,  and 
at  least  three  other  members  of  the  facility's  staff.  The  law  and  implementing  regulations  further 
mandate  that  this  committee  meet  at  least  quarterly  "to  identify  issues  with  respect  to  which 
quality  assessment  and  assurance  activities  are  necessary;"  and  that  it  "develop  and  implement 
appropriate  plans  of  action  to  correct  identified  quality  deficiencies."  The  law  and  regulations 
stipulate  that  committee  records  are  not  discloseable  except  to  the  extent  that  their  disclosure  is 
required  to  show  compliance  with  the  aforementioned  regulations  concerning  the  committee's 
composition  and  required  activities. 

The  quality  assessment  and  assurance  committee  ideally  could  serve  as  a  quality  improvement 
mechanism  within  the  facility  by  identifying  potential  and  existing  problems  and  correcting  them 
systemically  using  a  multidisciplinary  approach.  Understandably,  the  aforementioned  requirements 
caused  industry  apprehension  that  the  work  of  these  committees  would  be  used  as  a  tool  by 
HCFA  and  the  States  survey  agencies  to  uncover  facility  problems  with  punitive  result.  However, 
both  Congress  and  HCFA  took  steps  to  allay  this  fear.  As  a  result,  the  types  of  review  surveyors 
are  allowed  in  relation  to  these  committees  is  limited.  Section  1819(b)(1)(B)  of  the  Act,  for 
example,  provides  that  the  State  or  the  Secretary  of  Health  and  Human  Services  (HHS)  may  not 
require  disclosure  of  the  records  of  the  committee  except  inasmuch  as  disclosure  is  related  to 
establishing  compliance  with  the  requirements  for  its  existence,  composition,  frequency  of 
meeting,  and  function.  42  CFR  483.75(o)(4)  more  specifically  states  that,  "Good  faith  attempts  by 
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the  committee  to  identify  and  correct  quality  deficiencies  will  not  be  used  as  a  basis  for 
sanctions."265 

13.2  Introduction  -  Activity  Beyond  the  Regulatory  Realm 

Quality  assurance  or  improvement  systems266  are  not  limited  to  what  is  described  and  required 
under  the  regulations,  however.  Quality  improvement  initiatives  may  be  developed  and 
implemented  at  the  individual  nursing  home  level  or  may  represent  collaborative,  multi-agency 
efforts.  Many  of  the  primary  stakeholders  in  the  long-term  care  delivery  system  have  initiated 
efforts  to  improve  quality  of  care  and/or  life.  In  some  instances,  these  efforts  have  been  very 
specific  in  goal,  such  eliminating  the  inappropriate  use  of  physical  or  chemical  restraints  for 
residents.  Other  approaches  have  used  a  less  specific  focus,  such  as  coming  up  with  systems  for 
gathering  and  using  data  to  benchmark  progress  in  care  areas.  Training,  information  exchange, 
and  relationship  building  among  stakeholders  also  could  be  classified  as  attempts  to  effectuate 
positive  changes  in  the  lives  of  nursing  home  residents. 

13.3  Purpose 

Both  quality  improvement  initiatives  and  regulatory  standards  seek  to  improve  quality  of  care  and 
life  for  nursing  home  residents;  but  some  argue  that  one  function  impinges  on  the  other,  some  see 
one  as  a  compliment  to  the  other,  some  assign  these  activities  primary  and  secondary  importance, 
and  some  would  discard  one  or  the  other  given  the  opportunity.  This  report  will: 

•  Discuss  the  points  of  tension  and  the  relationship  between  the  regulatory  function  and 
quality  improvement  initiatives; 

•  Discuss  the  pros  and  cons  of  using  quality  improvement  initiatives, 

•  Review  non-regulatory  quality  improvement  initiatives  implemented  by  long-term  care 
stakeholders  such  as  facilities,  national  professional  associations,  and  governmental 
entities, 

•  Present  opinions  and  evaluations  of  the  effectiveness  of  these  initiatives. 

Please  note  that  the  period  of  data  collection  on  the  quality  improvement  initiatives  was  initially 
January  through  May,  1997,  and  was  extended  through  September  1997.  Many  quality 
improvement  initiatives  are  ongoing  and  may  have  progressed  beyond  the  stage  noted  in  this 
report.  For  many  of  the  quality  improvement  projects  mentioned,  results  were  either  formative  or 
process  evaluations,  and  should  not  be  taken  as  summative. 


State  Operations  Manual,  page  P-40,  revision  274. 

The  terms  "quality  assurance"  and  "quality  improvement"  are  used  interchangeably  in  this  report. 
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13.4     The  Quality  Improvement  Movement 


13.4.1  HCFA's  Interest  in  Quality  Improvement 

Essentially,  HCFA's  primary  responsibility  has  been  to  establish,  measure  compliance  with,  and 
enforce  regulatory  requirements;  therefore,  it  is  interesting  to  examine  how  HCFA  has  become 
involved  in  quality  improvement  initiatives  that  go  beyond  the  regulations.  A  number  of  factors 
have  contributed  to  an  interest  in  the  promise  of  quality  improvement  initiatives.  First,  HCFA 
developed  the  Minimum  Data  Set  (MDS)  in  response  to  a  legislative  mandate  in  19  8  7267  that 
required  the  Secretary  of  HHS  to  specify  a  minimum  data  set  of  core  elements  and  common 
definitions  for  use  by  nursing  facilities  in  conducting  the  regulatorily-required  resident  assessments 
and  to  establish  guidelines  for  use  of  the  data  set.  The  MDS  collects  data  through  resident 
assessment  measures  with  subsequent  progress  or  decline  documented  in  an  electronic  format. 
This  information  gathering  tool,  while  aimed  at  improving  assessment  and  consequent  care 
planning,  has  an  additional  benefit,  that  being  that  it  can  assist  surveyors  in  pre-survey  preparation 
by  highlighting  potential  areas  of  concern.  For  example,  a  facility  profile  (the  result  of  combining 
MDS  information  for  all  residents)  showing  that  a  high  number  of  residents  are  incontinent  of 
bowel  and  bladder,  but  that  few  have  individually  written  bladder  or  bowel  training  programs 
could  point  to  a  potential  area  of  investigation  for  surveyors  to  follow  once  onsite. 

This  data  might  also  serve  as  a  basis  for  developing  quality  indicators  (QIs)  to  measure  outcomes 
(and  thus  performance)  in  a  more  sophisticated  manner.  HCFA  is  investigating  the  potential  for 
QIs  to  both  improve  the  survey  system  and  serve  as  a  quality  improvement  tool.  Increasing 
demands  on  the  survey  and  certification  programs  and  cost  reimbursement  areas  without 
proportional  increases  in  funding  highlight  the  same  challenge  faced  by  most  Federal  agencies, 
i.e.,  how  to  get  the  most  out  of  an  allocation  that,  due  to  focus  on  national  debt  containment,  can 
only  grow  within  certain  parameters.  It  behooves  HCFA  to  take  a  hard  look  at  exactly  where 
Medicare  and  Medicaid  program  dollars  are  best  spent  and  how  to  obtain  better  care  for  nursing 
home  residents  with  those  dollars. 

There  is  potentially  a  significant  financial  motivation  to  improve  the  quality  of  services  in  nursing 
facilities.  For  example,  the  implementation  of  the  Agency  for  Health  Care  Policy  and  Research 
(AHCPR)  guidelines  to  prevent  and  treat  pressure  ulcers  could  potentially  save  at  least  $40 
million  annually.  The  National  Pressure  Ulcer  Advisory  Panel  estimated  the  cost  of  healing  a 
pressure  ulcer  to  be  between  $5,000  and  $25,000. 268  Finding  ways  to  promote  quality  care  to 
prevent  pressure  ulcers  could  have  positive  financial  results  as  well  as  a  positive  physical  and 
mental  impact  on  nursing  home  residents. 


See  §§  1 8 1 9(g)(6)  and  1 9 1 9(e)(5)  of  the  Social  Security  Act. 
Hausman  1994 
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HCFA  has  also  engaged  in  non-regulatory  quality  improvement  initiatives  that  would  perhaps 
better  be  understood  as  campaigns,  such  as  a  restraints  reduction  effort.  A  listing  of  interventions 
appears  in  Appendix  H;  several  specific  initiatives  that  have  had  more  of  a  multi-stakeholder  slant 
will  be  discussed  in  more  detail.  Efforts  have  involved  HCFA's  central  and  regional  offices,  State 
survey  agencies,  consumer  advocate  groups,  and  industry  representatives;  however,  more  often 
than  not,  initiatives  are  fragmented,  involving  individual  States  or  regions.  The  same  is  true  of 
efforts  developed  and  implemented  through  provider  organizations  and  State  nursing  home 
associations. 

13.4.2  Industry's  Interest  in  Quality  Improvement 

The  provider  community  alleges  that  the  regulatory  system  devotes  too  much  attention  to  State 
and  Federal  regulations  that  represent  paperwork  compliance  and  too  little  attention  to  assessing 
quality  of  care  beyond  cursory  observations.  Primarily  these  charges  are  levied  by  organizations 
such  as  the  Joint  Commission  on  Accreditation  of  Healthcare  Organizations  (JCAHO)  and  the 
American  Health  Care  Association  (AHCA). 

13.4.2.1  JCAHO 

JCAHO  has  formulated  a  set  of  requirements  it  purports  to  be  essential  in  the  provision  of  quality 
long-term  care.  JCAHO  conducts  onsite  surveys  examining  policies  and  procedures  of  nursing 
homes  that  voluntarily  seek  JCAHO  accreditation.  Facilities  meet  the  JCAHO' s  standards  for 
accreditation  based  on  certain  JCAHO-designated  performance  objectives/requirements. 
According  to  JCAHO,  facilities  adhering  to  these  requirements  could  have  the  foundation  to 
provide  care  and  to  continuously  assess  and  improve  the  quality  of  care  over  time.  At  present, 
JCAHO  accreditation  for  nursing  homes  does  not  result  in  deemed  status;  however,  in  regions 
where  managed  care  is  aggressively  moving  into  the  health  care  market,  more  nursing  homes  are 
applying  for  JCAHO  accreditation  to  meet  the  expectations  of  the  managed  care  organizations. 

13. 4.2.2  AHCA 

AHCA,  a  national  organization  representing  proprietary  member  nursing  homes,  has  developed 
and  implemented  several  programs,  referred  to  as  "the  Vision  for  Caregiving,"  that  are  presented 
as  a  reform  of  the  current  system.  The  AHCA  Vision  encompasses  a  Quest  for  Quality 
educational  component  for  training  facility  personnel  in  continuous  quality  improvement  (CQI) 
and  a  research  component  that  has  focused  on  development  and  field  testing  of  clinical  QIs  and 
customer  satisfaction  indicators.  The  training  dimension  of  the  Vision  for  Caregiving  also  instructs 
facility  personnel  in  the  administration  of  customer  satisfaction  instruments  and  the  use  of  a 
computerized  database  for  management  of  resident  data.  For  the  research  component,  AHCA  has 
measured  the  clinical  quality  and  performance  of  nursing  home  services  through  a  calculated 
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Quality  Improvement  Index  (QUIIX)  that  is  based  on  MDS-derived  QIs  that  measure  resident 
change  over  a  period  of  time.269 

According  to  AHCA,  strict  adherence  to  the  guiding  principles  for  change  underlying  the  Vision 
for  Caregiving  is  a  radical  departure  from  the  current  system.  These  guiding  principles  are  that: 
the  goal  of  an  assessment  system  must  be  improved  quality;  quality  must  be  outcomes  focused; 
and  quality  must  be  customer  driven  and  customer  defined.  In  addition,  the  criteria  from  which 
quality  is  measured  must  be  acceptable  and  appropriate  to  the  diverse  long  term  care  audience 
that  includes  residents,  family  members,  Federal  and  State  governments,  other  payors  and 
organized  consumer  groups.  The  AHCA  Vision  for  Caregiving  description  states  the  opinion 
that,  "Quality  is  internal.  An  external  inspection  process  will  never  create  true  quality."  AHCA 
posits  that  resident  expectations  differ  from  clinical  processes.  Therefore,  AHCA  feels  it  has 
developed  a  quality  improvement  system  to  advance  both  the  clinical  dimensions  of  care  and 
residents'  expectations  for  quality  of  life.  AHCA  also  espouses  the  use  of  "total  quality 
management"  (TQM)  principles  to  improve  quality  of  care,  and  has  provided  TQM  training 
sessions  attended  by  facility  owners,  administrators,  and  staff. 

TQM  includes  the  concept  of  continuous  quality  improvement  (CQI).  The  implementation  of  the 
TQM  principles  used  in  the  production  industry  is  more  difficult  in  health  care,  perhaps  because  of 
the  more  abstract  nature  of  health  care's  desired  end  product  (i.e.,  health).  Measuring  how  well 
nursing  homes  produce  or  maintain  health  is  complex,  and  the  standards  used  to  determine  the 
quality  of  the  product  are  still  in  evolution,  however,  CQI  systems  in  health  care  seek  to  define, 
measure,  and  improve  quality.270 

Like  HCFA,  long-term  care  facility  owners  search  for  ways  to  use  resources  more  efficiently  to 
improve  quality  of  services  and  care.  Improvement  is  important  because  of: 


The  QIs  have  been  developed  in  the  Multistate  Nursing  Home  Case-Mix  Quality  Demonstration  (which  will  be 
discussed  later  in  this  chapter).  The  indicators  have  been  developed  in  association  with  the  University  of 
Wisconsin  Center  for  Health  Systems  Research  and  Analysis  (CHSRA). 

TQM  and  the  key  concept,  "cycle  of  continuous  improvement,"  has  a  long  history  in  organizational  literature 
dating  from  the  early  part  of  this  century  within  American  industry.  More  recently,  it  has  been  identified 
primarily  with  the  work  of  Edward  Demming.  Still  more  recently,  the  concept  has  been  applied  within  health 
care  organizations,  particularly  hospitals  in  their  internal  efforts  to  lower  costs,  improve  efficiency,  or  improve 
consumer  satisfaction.  For  a  conceptual  discussion  of  the  organizational  quality  improvement  model  as  applied 
to  health  care  organizations,  particularly  hospitals,  see  Paul  Batalden,  "Organizationwide  Quality  Improvement 
in  Health  Care,"  Top  Health  Rec  Manage,  1991,  11(3),  1-12;  also  see  Berwick,  D.M.,  "Sounding  Board: 
Continuous  Improvement  as  an  Ideal  in  Health  Care,"  N  Engl  J  Med,  1989,320:53-56.  For  further  discussion 
of  the  application  of  TQM  to  nursing  homes,  see  section  13.8  below. 
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1 .  Economic  interest.  Facilities  respond  to  competitive  forces  to  procure  a  share  of  the  long- 
term  care  market.  As  managed  care  enters  the  long-term  care  arena,  nursing  homes  may 
need  to  demonstrate  quality  improvement  and  measurable  outcomes. 

Improved  care  and  practice  may  potentially  carry  a  significant  financial  incentive.  For 
example,  there  are  indications  that  costs  can  be  reduced  with  the  implementation  of  quality 
improvement  initiatives  focused  on  restraint  reduction.  In  a  research  project  of  12,000 
nursing  home  residents  in  250  facilities,  when  quality  improvement  projects  were 
implemented,  the  non-restrained  residents  required  fewer  minutes  of  direct  nursing  care 
when  compared  to  similar  residents  who  were  restrained.  The  implication  from  this 
comparison  of  residents  with  similar  conditions  was  that  costs  associated  with  direct 
services  were  reduced  rather  than  increased.  Another  study  demonstrated  that  the  nursing 
care  to  release,  exercise,  toilet,  monitor,  and  evaluate  a  restrained  resident  took  4.5  hours 
,  over  a  24  hour  period,  while  for  non-restrained  residents  care  took  2.7  hours  over  a  24- 
hour  period.  This  finding  supports  the  theory  that  improved  quality  of  care  may  be  result 
in  decreased  costs  associated  with  direct  care. 

2.  Professional  standards.  Most  nursing  homes  strive  for  a  commitment  to  high  standards  of 
practice.  Quality  improvement  initiatives  or  CQI  programs  may  promote  safe,  appropriate 
care  and  combat  potential  liability  issues  for  facilities. 

3.  Medical  considerations:  Improvements  in  facility  practices  (e.g.  restraint  use, 
psychotropic  medications,  incontinence  management)  benefit  residents.  Additionally, 
improved  medical  status  may  result  in  a  cost  benefit. 

4.  Accountability.  Facilities  are  accountable  to  the  public  for  the  quality  of  services  they 
provide,  particularly  as  consumers  become  more  informed  and  the  public  demands  quality 
for  the  tax-payer  dollar. 

13.5     The  Relationship  of  Quality  Improvement  Initiatives  to  Survey  and  Certification 

AHCA's  initiatives,  JCAHO's  standards,  and  facility  CQI  programs  invest  resources  in  quality 
improvement  with  the  intent  of  improving  quality  of  care  and  services.  HCFA  seeks  to  ensure  and 
improve  quality  of  care  and  services  primarily  through  regulatory  effort.  How  are  these  activities 
related"? 

For  the  most  part,  HCFA's  quality  improvement  initiatives  are  seen  as  a  supplementary  or 
secondary  activity,  with  surveying  for  regulatory  compliance  continuing  to  be  the  primary 
approach  HCFA  takes  to  ensuring  quality.  At  the  Quality  Assessment  and  Assurance  Symposium 
(QAAS)  held  in  June  1996,  some  participants  argued  that  HCFA  should  consider:  (1)  investing  in 
facility-initiated  quality  improvements  associated  with  improved  resident  outcomes,  and  (2) 
reallocating  limited  survey  resources  to  focus  on  facilities  that  have  not  directed  any  resources  or 
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activity  into  internally-initiated  quality  improvement  processes.  Other  stakeholders,  however, 
strongly  disagree  with  this  viewpoint. 

13.5.1  Arguments  for  a  Shift  of  Focus  to  Quality  Improvement  Initiatives 

Proponents  of  non-regulatory  quality  improvement  initiatives  state  that  the  regulatory  survey  and 
enforcement  systems  are  not  conducive  to  fostering  quality  improvement.  Facility  surveys  are 
conducted  every  12  months  on  average;  the  time  span  between  visits  allows  for  decline.  The 
"snapshot"  approach  to  quality  measurement  (visiting  a  facility  only  a  few  days  out  of  the  year) 
does  not  foster  continuing  efforts  to  maintain  quality.  The  survey  and  enforcement  systems 
actually  create  an  environment  where  the  priority  becomes  finding  quick  solutions,  failure  to  do  so 
could  incur  punishment.  As  noted  in  the  discussion  below,  nursing  homes  find  it  easier  to  chart 
compliance  to  regulations  and  standards  than  to  change  the  work  processes  that  produce  the 
actual  changes  that  are  needed.  Proponents  argue  that  in  contrast,  quality  improvement  initiatives 
promote  a  lasting  and  systematic  means  of  improving  the  quality  of  services.  They  feel  that  the 
survey  process  is  reactive  rather  than  proactive,  meaning  that  the  it  tends  to  identify  situations 
only  after  they  have  become  full-blown  problems.  The  quality  improvement  model,  they  argue, 
identifies  systems  or  processes  that  should  be  altered  to  prevent  adverse  outcomes,  which  is  a 
proactive  approach. 

Critics  counter  this  argument  by  reasoning  that  the  "proactive"  effort  is  not  the  most  efficient  use 
of  limited  resources  and,  instead,  effort  should  remain  focused  on  correcting  evident  deficiencies. 
Proponents  meet  this  argument  by  positing  that  if  facilities  received  more  direction  and  guidance 
through  the  survey  process,  they  would  be  better  prepared  to  prevent  adverse  outcomes  and  less 
effort  would  be  expended  on  enforcement  sanctions.  The  survey  process  would  be  more 
responsive  to  the  range  of  conditions  and  situations,  including  the  mix  of  resident  acuity  levels  and 
needs  of  the  facility  population,  if  the  process  combined  both  reactive  and  proactive  dimensions  to 
prevent  adverse  outcomes. 

Providers  also  feel  that  facilities'  staff  members  have  to  dedicate  too  much  attention  to 
understanding  the  interpretation  of  the  regulations  and  providing  documentation  to  show  the 
facilities'  compliance  with  the  regulations.  Time  and  limited  personnel  resources  have  to  be 
shifted  away  from  the  internal  quality  improvement  efforts  to  prepare  for  the  regulatory  survey.  If 
facilities  are  motivated  to  improve  the  quality  of  services  by  using  quality  improvement  systems, 
they  need  to  be  able  to  commit  time  and  resources  to  improve  service  delivery.  Focusing  on 
regulations  detracts  from  the  amount  of  resources  that  can  be  dedicated  to  quality  improvement 
efforts. 

Proponents  of  a  shift  to  increased  quality  improvement  initiatives  could  agree,  however,  that  some 
aspects  of  enforcement  would  still  be  needed  as  there  are  long-term  care  providers  who  require 
assessment,  regulation,  and  the  imposition  of  fines  or  other  corrective  action  to  safely  provide 
care  Discussion  at  the  Quality  Assessment  and  Assurance  Symposium  (QAAS)  included  the 
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regulators'  position  that  enforcement  can  exist  concurrently  with  internally-initiated  quality 
improvement  efforts.  Selected  nursing  homes  will  initiate  and  maintain  quality  improvement 
efforts  motivated  by  competition,  market  forces,  altruism,  and  professional  standards.  However, 
most  nursing  homes  might  not  sustain  continuing  efforts  for  improving  quality  unless  regulatory 
requirements  with  the  possibility  of  penalty  imposition  or  perhaps  other  incentives  existed.  The 
QAAS  participants  remarked  upon  the  potential  value  of  positive  incentives  (both  monetary  or 
non-monetary),  such  as  public  recognition,  monetary  rewards,  or  administrative  convenience,  to 
encourage  quality  care.271 

13.5.2  Arguments  Against  a  Shift  of  Focus  to  Quality  Improvement  Initiatives 

The  resource  reallocation  proposal  is  likely  to  meet  stiff  resistance  from  nursing  home  resident 
advocacy  groups.  In  spite  of  perceived  shortcomings  in  the  strength  of  regulations,  manual 
instructions,  and  enforcement  in  general,  advocacy  groups  would  not  argue  for  a  diminished 
regulatory  focus,  but  an  increase  in  regulatory  activity  and  enforcement.  Advocates  maintain  that 
the  enforcement  system  should  ensure  that  facilities  meet  the  threshold  standards  and  promote 
quick  correction  of  deficiencies,  at  a  minimum.  While  it  is  possible  that  some  members  of  this 
camp  may  feel  that  facility-specific  or  long-term  care  association-wide  quality  improvement 
initiatives  could  complement  regulatory  efforts,  it  is  doubtful  that  many  would  stomach  integral 
government  involvement  in  these  efforts.  Often  the  issue  of  resources  has  been  the  response  when 
advocates  have  complained  about  the  weak  enforcement  of  requirements.  Other  activities,  such 
Federal  and  State  involvement  in  quality  improvement  efforts,  might  be  seen  as  a  force 
diminishing  already  inadequate  resources. 

An  article  in  the  November  7,  1997,  edition  of  the  National  Senior  Citizens  Law  Center's 
newsletter,  The  Nursing  Home  Law  Letter,  entitled,  "HCFA  Retreats  from  Regulatory  Role," 
expressed  the  consumer  advocates'  dismay  at  HCFA's  shift  away  from  regulatory  intervention  to 
cooperative  quality  improvement  initiatives.  The  article  discussed  the  history  of  this  change  and 
the  "questionable"  premise  on  which  the  shift  was  based: 

"Gagel  [the  director  of  HCFA's  Health  Standards  and  Quality  Bureau]  reports  that 
HCFA's  traditional  quality  assurance  programs  focus  on  external  management  programs, 
which  identify  poor  care  and  either  demand  correction  or  expulsion  from  the  federal 
payment  program.  These  external  programs  are  only  'marginally  successful,'  she  [Gagel] 
contends,  citing  the  Institute  of  Medicine's  1986  report  'Improving  the  Quality  of  Care  in 
Nursing  Homes.'  While  the  Institute  of  Medicine  (IoM)  did  indeed  find  that  public 
enforcement  systems  often  failed  to  bring  about  high  quality  of  care  for  nursing  home 
residents,  it  found  fault  with  state  and  federal  enforcement  systems  that  tolerate  poor 
performance  and  that  seek  to  'consult'  providers  into  compliance.  IoM  recommended 


See  Chapter  12  for  a  discussion  of  the  history  of  incentives  linked  to  outcomes  and  the  current  status  of  this 
option. 


Study  of  Private  Accreditation  (Deeming)  of  Nursing  Homes,  346 
Regulatory  Incentives  and  Non-Regulatory  Initiatives,  and 
Effectiveness  of  the  Survey  and  Certification  System 


strengthening  public  enforcement  systems  so  that  they  would  be  less  permissive  and  would 
impose  remedies  promptly  when  deficiencies  were  first  identified."272 

Of  particular  concern  is  the  "retreat"  from  the  regulatory  role,  as  mentioned  earlier.  While  quality 
improvement  initiative  supporters  deny  that  models  such  as  the  South  Dakota  proposal  (which 
will  be  discussed  later)  place  the  surveyor  in  the  role  of  a  consultant  rather  than  a  regulator,  the 
advocates  might  be  inclined  to  disagree;  in  fact,  even  in  the  current  environment,  there  is  a 
perception  that  surveyors  are  sliding  into  this  role  and  out  of  the  regulatory  one.  In  a  1996  letter 
to  then-HCFA  administrator  Bruce  Vladeck,  Scott  Severns,  president  of  the  National  Citizen's 
Coalition  for  Nursing  Home  Reform,  wrote: 

"They  [surveyors]  need  leadership  that  gives  them  a  strong  statement  of  purpose  and  to  be 
reminded  continually  that  their  peers  in  nursing  homes  are  not  the  reason  for  their  activity. 
•  They  have  no  role  is  setting  the  professional  development  or  morale  of  line  staff  in  nursing 
homes,  except  in  those  rare  instances  when  government  takeover  of  facility  management  is 
done  to  protect  residents.  The  surveyors'  role  is  to  assure  that  nursing  home  owners  and 
managers  are  given  proper  incentive  to  manage  effectively  for  good  outcomes  for 
residents."273 

Later  in  the  same  letter,  Severns  again  spoke  to  these  points: 

"The  difference  between  the  role  of  the  private  consultant  and  the  public  regulator  must  be 
reiterated  and  enforced.  IOM  [the  Institute  of  Medicine  study]  firmly  rejected  the  notion 
that  surveyors  should  attempt  to  serve  as  consultants. 

a.  HCFA  should  announce  clearly  that  the  consultant  role  for  surveyors  is  ineffective, 
wasteful  of  scarce  resources  and  directed  at  the  wrong  people  (line  staff  rather 
than  management). 

b.  Survey  and  enforcement  management  must  constantly  guard  against  the 
seductiveness  of  the  consultant  role  for  many  people  employed  by  the  regulatory 
process. 

c.  Surveyors  must  never  assume  responsibility  for  the  behavior  and  morale  of  line 
staff  in  nursing  homes."274 


Edelman,  T.  (editor)  "HCFA  Retreats  from  Regulatory  Role."  The  Nursing  Home  Law  Letter,  Issue  No.  3, 
1997.  p  2. 

Severns,  S.,  in  letter  to  Bruce  Vladeck  dated  April  17,  1996;  p  3. 
Ibid,  p  5. 
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The  Nursing  Home  Law  Letter  also  pointed  to  what  may  be  a  significant  shortcoming  in  the 
quality  improvement  initiatives  approach;  the  lack  of  evidence  supporting  their  effectiveness.  The 
article  states: 

"Gagel  [in  the  article  "Health  Care  Quality  Improvement  Project:  A  New  Approach," 
Health  Care  Financing  Review]  recites  HCFA's  'experience  that  a  provider's  own 
quality-management  system  is  the  key  to  good  performance,'  but  she  does  not  report  what 
that  federal  experience  has  been.  Again,  in  the  nursing  home  context,  the  experience  with 
quality  assurance  has  not  been  promising. 

In  March  1991,  Beverly  Enterprises,  the  largest  nursing  home  corporation  in  the  United 
States,  entered  a  Settlement  Agreement  with  the  state  of  Missouri,  resolving  a  series  of 
pending  criminal  and  civil  investigations.  Part  of  the  settlement  required  Beverly  to 
,  implement  an  intensified  version  of  its  Quality  Assurance  (Q  A)  program  throughout  the 
state.  The  Food  and  Allied  Services  Trade  Department  of  the  AFL-CIO  (FAST)  studied 
the  results  of  this  effort,  specifically  the  quality  of  care  provided  in  35  Beverly  facilities  in 
Missouri  from  April  1991  to  December  1993.  FAST  looked  at  three  quality  factors:  the 
prevention  and  treatment  of  bedsores,  the  presence  of  unnecessary  physical  or  chemical 
restraints,  and  the  prevention  and  treatment  of  incontinence.  FAST  found  that  while 
Beverly's  intensified  QA  program  successfully  identified  violations  of  care  standards,  the 
program  did  not  prevent  recurrence  of  care  problems."275 

However,  it  cannot  be  assumed  from  these  comments  that  the  advocates  on  the  whole  object  to 
quality  improvement  projects  or  initiatives;  only  that  HCFA's  involvement  in  these  efforts  is 
incongruous  with  what  many  advocates  consider  to  be  HCFA's  appropriate  role.  HCFA  should,  in 
their  minds,  act  as  the  regulator,  monitor,  and  enforcer  of  standards.  Softening  this  approach  by 
allowing  quality  improvement  initiatives  to  substitute  for  these  activities  is  inappropriate.  The 
article  in  The  Nursing  Home  Law  Letter  summarizes  this  position: 

"Advocates  for  beneficiaries  recognize  that  facility-based  quality  improvement  activities 
may  have  a  role  in  health  care.  We  welcome  health  care  providers'  taking  responsibility  for 
the  care  they  provide  and  not  waiting  for  state  and  federal  regulatory  agencies  to  tell  them 
what  their  problems  are  and  how  to  correct  them.  However,  quality  improvement  is  only 
the  internal  process  of  getting  good  care;  it  is  not  the  outcome  of  good  care.  Whether  a 
health  care  facility  is  actually  providing  good  care  in  compliance  with  public  standards  is 
the  critical  issues  and  it  is  a  decision  that  only  a  public  agency  can  make." 


Edelman,  T.  p  3. 
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13.5.3  Balancing  Roles 


At  the  June  1996  nursing  home  Quality  Assessment  and  Assurance  Symposium  (QAAS),  several 
recommendations  were  discussed  for  a  future  expansion  of  the  regulatory  role  to  support  quality 
improvement  in  long-term  care.  The  focus  of  these  recommendations  was  the  development  of  an 
educational  function  that  could  either  be  assumed  by  regulators  or  be  delegated  to  another  entity. 
There  were  four  different  configurations  of  how  an  expanded  educational  function  might  be 
implemented:  (1)  a  regulating  agency  as  an  educator  of  long-term  care  facility  personnel;  (2)  an 
intermediate  agency  to  disseminate  information,  (3)  an  intermediate  agency  guiding  facilities  to 
use  data  and  improve  systems;  or  (4)  State  agency  as  collaborator  through  an  onsite  facilitator  to 
support  quality  improvement  activity. 

In  these  hypothetical  configurations,  the  regulatory  agencies  or  their  designee  would  collect 
facility-specific  information,  aggregate  this  information  to  draft  descriptive  reports  of  QIs,  and 
disseminate  such  reports  to  facility  staff.  Under  these  different  configurations,  the  facilities  would 
acquire  different  types  and  levels  of  direction  or  assistance  in  the  use  of  such  data.  One  model 
would  involve  re-educating  surveyors  to  be  purveyors  of  aggregated  data  to  the  facilities.  Another 
model  would  use  an  intermediate  agency  to  disseminate  information.  In  the  third  model,  the 
intermediate  agency  would  take  on  an  expanded  role  to  provide  related  technical  assistance  to 
facilities  upon  their  receipt  of  the  aggregated  data.  The  fourth  model  re-configures  the  present 
role  of  the  survey  agency  so  that  it  would  provide  an  onsite  facilitator  to  guide  each  facility  to  use 
data  reports  as  a  basis  for  revising  practices. 

13.5.4  The  Surveyor  Role:  What  is  Currently  Permitted? 

13. 5. 4. 1     Technical  Assistance  or  Consultation ? 

The  following  sections  describe  the  wide  variety  of  long-term  care  quality  improvement  initiatives 
as  well  as  the  absence  of  currently  available  evidence  supporting  their  effectiveness.  Even  if 
supporting  evidence  emerges  in  the  future,  there  still  remains  the  question  of  how  these 
interventions  relate  to  the  survey  and  enforcement  systems.  For  example,  is  it  permissible,  or 
even  appropriate,  for  surveyors  to  offer  technical  assistance  on  quality  improvement  to  providers? 
The  role  of  HCFA  described  in  the  law  clearly  delineates  its  duties  to  set  and  measure  compliance 
with  standards  for  nursing  home  care.  Similarly  outlined  is  the  contractual  relationship  between 
the  Secretary  of  HHS  and  the  State  survey  agencies  to  carry  out  this  function.276  Per  §4101  of 
the  Program  Administration  and  Fiscal  Management  instructions  to  all  surveyors  (April,  1980), 
the  advice  provided  by  surveyors  to  providers  should  be  concerned  with  the  specific  steps  that  the 
facility  must  take  to  meet  program  requirements.  Further  explanation  of  the  limitation  placed  on 
all  (not  just  nursing  home)  surveyors  regarding  direct  assistance  in  the  form  of  technical  assistance 


276         It  is  interesting  to  note,  however,  that  HCFA  and  the  States  have  initiated  various  non-regulatory  interventions 
aimed  at  quality  improvement  in  addition  to  carrying  on  their  traditional  regulatory  and  inspection  roles. 
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is  found  in  §2727,  "Limitation  on  Technical  Assistance  Afforded  by  Surveyors"  (revision  to  the 
SOM,  March  1989): 

"When  deficiencies  are  found,  provide  an  explanation  to  the  provider  concerning  the 
deficiency  in  specific  terms  (not  data  tags  or  regulation  citations)  to  allow  the  provider  to 
understand  why  the  requirement  is  not  met.  Frequently,  the  explanation  will  embody  the 
action  needed  to  correct  the  problem.  In  situations  where  there  may  be  several 
possible  causes  for  the  deficiency  it  is  not  your  responsibility  to  delve  into  the 
facility's  policies  and  procedures  to  determine  the  root  cause  of  the  deficiency,  or  to 
sift  through  various  alternatives  to  suggest  an  acceptable  remedy.  For  example,  if  a 
provider  was  cited  for  maintaining  incomplete  records,  specify  what  is  missing  ~  not  why 
it  is  missing  or  what  process  is  the  best  for  ensuring  that  the  records  will  be  complete  in 
the  future. 

Outside  of  the  survey  process,  SAs  are  encouraged  to  communicate  with  providers  and 
their  associations.  Discussions  of  program  requirements  and  the  survey  process  can  result 
in  a  better  understanding  of  the  process  by  all  parties  involved. 

When  deficiencies  are  found  current  regulations  specify  that  any  explanation  offered  by  the 
surveyors  is  to  be  sufficiently  specific  to  allow  the  provider  to  understand  why  a  requirement  is 
not  met.  This  section  further  delineates  that  it  is  not  the  position  of  the  surveyors  to  identify  the 
root  cause  of  a  deficiency  nor  to  identify  the  acceptable  remedy  for  a  deficiency  which  could  be 
construed  as  technical  assistance.  Although  this  section  seems  to  place  severe  limitations  on 
technical  assistance  afforded  by  surveyors,  it  does  encourage  survey  agencies  "outside  of  the 
survey  process  "  to  communicate  with  providers  and  their  association,  although  it  would  seem  to 
limit  that  communication  to  discussions  of  program  requirements. 

13.5.4.2    Information  Transfer 

If  some  kinds  of  activities  that  could  be  construed  as  technical  assistance  are  prohibited,  it  appears 
that  other  kinds  of  similar  activities  are  permitted.  Task  IX  in  the  SOM  Survey  Procedures  for 
Long  Term  Care  Facilities  states  that: 

".  .  .  the  State  should  provide  information  to  the  facility  about  care  and  regulatory  topics 
that  would  be  useful  to  the  facility  for  understanding  and  applying  the  best  practices  in  the 
care  and  treatment  of  long  term  care  residents. 

This  information  exchange  is  not  a  consultation  with  the  facility,  but  is  a  means  of 
disseminating  information  that  may  be  of  assistance  to  the  facility  in  meeting  long  term 
care  requirements   States  are  not  liable,  nor  are  they  to  be  held  accountable  if  training 
which  occurs  during  information  transfer  does  not  "correct"  problems  at  the  facility. 
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Performance  of  the  function  is  at  the  discretion  of  the  State  and  can  be  performed  at 
various  times,  including  during  the  standard  survey,  during  fcilow-up  or  complaint 
surveys,  during  other  conferences  or  workshops  or  at  another  time  mutually  agreeable  to 
the  survey  agency  and  the  facility..." 

13.5.5  Appropriate  Surveyor  Role:  Solely  Determining  Compliance  to  Standards? 

Some  have  argued  that  the  traditionally  accepted  role,  solely  determining  compliance  to 
standards,  is  the  only  appropriate  role.  This  formulation,  however,  may  not  be  as  straight  forward 
as  many  assume.  In  practice,  surveyors  exercise  a  considerable  amount  of  discretion  in  the 
performance  of  this  regulatory  role.277  They  make  allowances  for  changes  in  ownership,  the 
problems  faced  by  the  administrator  and  director  of  nursing  and  how  hard  they  are  trying,  whether 
a  nursing  home  still  out  of  compliance  is  doing  better  than  its  has  in  the  past,  how  much  effort  it 
would  take  to  write  up  and  gather  evidence  in  support  of  a  deficiency,  and  if  they  did  go  through 
this  extra  work,  whether  their  supervisors  at  the  State  agency's  office  would  back  them  up.  In 
short,  nursing  home  surveyors,  like  regulators  in  other  settings,  are  "street-level  bureaucrats"  who 
in  practice  exercise  considerable  discretion  as  they  informally  negotiate  their  regulatory  role. 

It  is  arguable  that  this  discretion  is  a  good  thing  -  it  creates  a  less  rigid,  more  flexible  survey 
process  better  adapted  to  what  is  achievable  through  regulation.  On  the  other  hand,  the  net  effect 
is  to  create  less  consistent  enforcement  and  undermine  confidence  that  the  public  and  various 
other  constituencies  who  are  not  a  party  to  these  negotiations  are  protected.  Under  these 
circumstances,  is  it  appropriate  public  policy  to  deliberately  increase  the  inherent  discretion  in  the 
system  by  expanding  the  accepted  roles  of  surveyors?  In  short,  would  expansion  of  the  roles 
compromise  the  fundamental  and  legally  required  surveyor  function,  that  of  determining 
compliance  to  standards? 

13.5.6  State  of  Washington's  Quality  Assurance  Nurses  (QANs):  Example  of 
Successful  Integration  of  Roles? 

The  State  of  Washington  may  provide  an  example  of  an  expanded  information  transfer  role  by  the 
activities  performed  by  their  Quality  Assurance  Nurses  (QANs).  The  role  of  the  QAN  is  to 
explain  to  the  nursing  home's  staff  what  a  regulation  requires  and  how  it  is  reviewed  during  the 
survey.  But,  the  QAN  does  not  consult  with  the  facility  on  actions  to  take  to  address  an  issue. 
This  "information  transfer"  function  also  consists  of  validating  best  practices,  identifying 
exemplary  practices,  and  identifying  problem  areas  while  they  are  small  and  manageable  to 
correct.  The  QANs  perform  their  information  dissemination  task  separately  from  the  survey 
process.  However,  they  are  trained  as  surveyors,  and  on  occasion  exchange  their  QAN  roles  for 
surveyors  roles  by  participating  as  survey  team  members.  They  can  also  cite  a  facility  for 


See  Chapter  1 5  for  a  discussion  of  discretion  in  regulatory  systems 
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deficiencies  when  acting  as  QANs,  although  this  would  be  exceptional.  The  functions  of  the 
QANs  are  discussed  in  greater  detail  in  Section  13.6.4.6.  For  now  it  should  be  noted  that  the 
State  of  Washington  may  resolve,  or  at  least  balance,  the  inherent  conflict  between  the  traditional 
surveyor  role  of  determining  compliance  and  an  expanded  information  transfer  role  by  separating 
these  two  functions.  The  two  functions  are  not  performed  at  the  same  time,  and  generally  not 
performed  by  the  same  person. 

13.6     Prior  and  Current  Initiatives 

13.6.1  Methods  for  Collecting  Information 

The  focus  of  this  report  is  multi-agency,  collaborative  quality  improvement  initiatives,  including 
projects  initiated  by  HCFA's  central  and  regional  offices,  State  survey  agencies,  other  health 
organizations  (including  but  not  limited  to  AHCA),  and  PROs.  Educational  presentations, 
behavioral  interventions,  data  collection,  and  information  dissemination,  including  one-time  and 
continuing  interventions,  were  included.  This  report  does  not  review  CQI  programs  that  are 
facility  specific  and  implemented  by  decision  of  the  independent  facility  or  at  a  corporate  level  for 
multi-site  facilities. 

To  gather  information  on  these  initiatives,  we  used:  (1)  key  informant  interviews  with  the 
individuals  most  familiar  with  the  specific  initiatives;  and  (2)  reviews  and  analysis  of  any  available 
reports,  quarterly  summaries,  working  documents,  or  completed  reports  from  the  pilot  studies  and 
initiatives.  Key  informants  about  these  efforts  were  associated  with  several  different  agencies  and 
associations,  and  included:  HCFA  central  office  project  officers  and  project  directors,  HCFA 
regional  offices'  project  directors;  AHCA;  the  Association  of  Ohio  Philanthropic  Homes,  Housing 
and  Services  for  the  Aging;  and  the  Center  for  Health  Systems  Research  &  Analysis  (CHSRA), 
University  of  Wisconsin-Madison.  A  complete  list  of  individuals  who  provided  information  for 
this  report  is  contained  in  Appendix  H.  Whenever  possible,  several  key  informants  from  several 
different  agencies  or  organizations  were  interviewed  about  an  initiative  to  get  a  more  complete 
perspective.  There  was  an  effort  at  triangulation  of  data  sources  by  using  written  reports  and  data 
summaries  as  one  source  of  information  in  conjunction  with  interviews  with  individuals  who  were 
knowledgeable  about  these  initiatives.  Two  additional  means  of  identifying  long-term  care  quality 
improvement  initiatives  were  computer-aided  searches  in  published  health  services  literature  and 
reviews  of  HCFA-prepared  comprehensive  inventories  of  any  quality  improvement  efforts. 

The  relevant  initiatives  fit  within  several  categories: 

Clinical  topics:  efforts  undertaken  at  a  State,  regional,  or  national  level  that  relate  to  improving 
outcomes  for  specific  clinical  conditions,  such  as  pressure  ulcers  and  incontinence,  or  the  use  of 
physical  restraints  and  psychotropic  drugs. 
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General  interventions  affecting  facility  behavior  (rather  than  modifying  or  building  upon  survey 
and  enforcement  processes) .  changes  in  individualized  resident  care  that  are  major  shifts  from  the 
medical  model  and  task-focused  resident  care. 

Data  initiatives  and  changes  affecting  State  survey  agency  behavior  applications  or  tests  of  QIs 
or  alternative  survey  strategies  and  means  to  collect  and  disseminate  information. 

The  descriptive  lists  of  the  initiatives  are  contained  in  Appendix  H. 
13.6.2  Clinical  Topics 

13.6.2.1    Pressure  Ulcers 

The  IOM  identified  the  prevalence  of  pressure  ulcers  as  an  indicator  of  the  quality  of  care 
provided  by  nursing  homes.278  The  development  of  pressure  ulcers  is  an  undesirable  outcome  that 
can  be  prevented  in  most  residents  except  those  at  very  high  risk.  The  costs  of  implementing 
prevention  programs  are  high.  To  reduce  the  costs,  prevention  efforts  target  persons  at  high  risk. 

Six  PROs  (from  HCFA's  Northeast  Consortium,  comprised  of  Regions  I,  II,  and  III)  have 
developed  quality  improvement  projects  to  implement  the  Agency  Health  Care  Policy  and 
Research  (AHCPR)  guidelines  for  the  prevention  and  treatment  of  pressure  ulcers  for  at-risk 
nursing  home  residents.  These  PRO  projects  are  a  departure  from  the  previous  efforts  focusing  on 
the  acute  care  setting,  representing  the  first  collaborative  arrangements  with  nursing  homes.279 
The  projects  were  formulated  based  on  small  pilot  projects  or  other  preliminary  studies  that 
supported  a  design  based  on  data  collection  and  abstraction  from  facilities.  Data  were  abstracted 
from  the  admission  and  clinical  records  of  residents  who  met  the  established  profiles,  i.e.,  those 
residents  who  had  some  degree  of  mobility  impairment  and  a  minimal  length  of  stay.  The  PROs 
evaluated  the  implementation  of  the  AHCPR  clinical  guidelines  for  four  goals  for  prevention  of 
pressure  ulcer  formation.  The  intervention  included  drafting  a  written  report  that  included  the 
facility  baseline  data  and  opportunities  for  improvement.  Further  direct  research  interventions 


Zinn,  1993. 

Results  of  a  quality  improvement  program  related  to  pressure  sores  in  the  acute  care  setting  (implemented  by 
the  Missouri  PRO)  demonstrated  that  all  four  facilities  improved  m  the  regular  performance  of  a  risk 
assessment  within  24  hours  of  admission  to  the  hospital,  implementation  of  prevention  interventions  within  24 
hours  of  identification  of  risk  factors,  initiation  of  treatment  protocol  within  24  hours  of  identification  of  a 
pressure  ulcer,  and  patient  education.  Three  of  the  four  acute  care  settings  improved  their  facility  wide  rates  of 
implementation  of  preventive  interv  entions  within  24  hours  of  risk  identification,  from  3  percent  to  23  percent 
Four  of  four  acute  care  settings  improved  initiation  of  treatment  protocols  within  24  hours  of  identification  of 
pressure  ulcers,  from  8  percent  to  24  percent.  The  results  from  the  acute  care  settings  supported  the 
implementation  of  the  intervention  in  the  long-term  care  setting,  although  no  evidence  was  presented  of  an 
actual  reduction  in  pressure  ulcers. 


Study  of  Private  Accreditation  (Deeming)  of  Nursing  Homes,  353 
Regulatorv  Incentives  and  Non-Regulatory-  Initiatives,  and 
Effectiveness  of  the  Survev  and  Certification  Svstem 


included  symposia  for  participating  facility  personnel  to  identify  best  practices  and  potential 
implications  for  resident  care. 

The  PROs,  in  conjunction  with  the  Divisions  of  Health  Standards  and  Quality  in  Regions  I,  II,  and 
III,  and  the  respective  State  survey  agencies  collaborated  on  data  collection  for  the  pressure  ulcer 
projects.  The  project  aimed  to  obtain  aggregate  baseline  data  on  pressure  ulcers  at  selected 
nursing  homes  for  use  in  monitoring  the  reduction  of  pressure  ulcers. 

Results  indicating  the  successfulness  of  the  intervention  are  not  available,  owing  in  part  to 
continuing  data  collection.  At  least  one  project  is  drafting  the  aggregated  facility  data  to  be  shared 
with  individual  facilities  in  1998. 

13. 6. 2. 2  Toledo,  Ohio  Pressure  Ulcer  Prevention  Initiative 

This  initiative  targeted  all  nursing  homes  in  the  Toledo  catchment  area  with  the  objective  of 
reducing  the  incidence  and  prevalence  of  pressure  ulcers.  There  were  three  components  of  this 
intervention  directed  at  providers:  1)  feedback  data  on  the  incidence  and  prevalence  of  pressure 
ulcers;  this  was  the  most  important  component  of  the  intervention  and  enabled  providers  to 
compare  their  pressure  ulcer  rates  with  their  past  performance  as  well  as  other  Toledo  facilities,  2) 
educational  materials  in  the  form  of  AHCPR  guidelines  on  pressure  ulcer  prevention;  and  3)  an 
additional  educational  effort  in  the  form  of  an  invitation  to  a  symposium  on  topics  related  to  the 
prevention  of  pressure  ulcers.  An  evaluation  was  conducted  employing  a  quasi-experimental 
design  with  a  control/comparison  group  of  nursing  homes  in  the  Columbus,  Ohio  catchment  area. 
This  initiative  and  the  evaluation  results  are  discussed  in  greater  detail  in  Section  13  .7.2.4. 

13.6.2.3  Restraints  Reduction 

Activities  related  to  restraints  reduction  reflect  a  broad-based  participation  by  stakeholders  and 
include  a  range  of  approaches,  such  as  the  use  of  multiple  media  strategies.  The  workgroups  and 
task  forces  have  been  convened  in  different  States  to  bring  together  association  representatives, 
provider  groups,  State  agencies,  and  consumer  groups.  These  initiatives  have  attempted  to  forge  a 
working  relationship  among  stakeholders.  Efforts  emphasize  the  need  to  consider  restraints 
alternatives  and  comparative  data  that  indicates  high  rates  of  restraints  for  certain  geographic 
regions. 

In  independent  facilities  and  in  multi-facility  corporations,  the  most  effective  restraint  reduction 
activities  have  been  broad  based  inter-disciplinary  projects  that  included  administrators,  nursing 
directors,  physical  and  recreational  therapists,  service  delivery  staff  including  nursing  assistants, 
and  housekeeping  personnel.280 
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Two  particularly  relevant  examples  of  cooperative  restraints  reduction  efforts  have  been  enacted 
in  Connecticut  and  Georgia. 

13.6.2.3.1  Connecticut 

In  Connecticut,  the  Breaking  the  Bonds  Coalition  is  composed  of  nursing  home  personnel, 
researchers,  State  survey  agency  representatives,  and  professional  trade  associations  who 
committed  their  time  to  continuing  education  to  reduce  restraints  use  and  promote  individualized 
care.  The  Coalition  was  implemented  through  the  State  Ombudsman's  office,  but  has  been 
sustained  through  high  multi-agency  volunteer  commitment.  The  initiative  has  further  benefited 
from  ongoing  project  evaluation  research  supported  through  the  Braceland  Center  for  Mental 
Health  and  Aging.281  The  project  has  been  unique  in  its  focus  on  the  identification  and  reduction 
of  barriers  to  implementing  changes  that  would  reduce  physical  and  chemical  restraints,  increase 
individualized  care,  and  improve  the  quality  of  life  for  nursing  home  residents. 

The  first  strategy  in  early  1994  was  a  mail  survey  to  all  nursing  homes  in  the  State.  The  survey 
showed  that  nursing  home  staff  worked  under  a  false  perception  that  restraints  prevented  falls  and 
injuries  (which  is  contrary  to  research  findings  indicating  that  restraints  do  not  prevent  falls  and 
injuries).  The  survey  responses  indicated  a  need  for  education;  but  respondents  were  generally  not 
aware  of  available  resources  for  training.  In  response  to  the  identified  need,  seven  Breaking  the 
Bonds  educational  conferences  were  held  from  late  1994  through  June  1997. 

Walker's  work  reported  that  the  major  accomplishments  of  these  conferences  were  that:  (1) 
barriers  to  reducing  restraints  use  were  identified;  (2)  knowledge  and  alternative  approaches  were 
conveyed  in  a  relevant  and  applicable  manner,  and  (3)  those  attending  the  conferences  succeeded 
in  implementing  changes  in  their  respective  facilities.  The  conferences  disseminated  information 
and  corrected  misperceptions  such  as: 

Inadequate  staffing  is  a  barrier  to  new  practices  promoting  restraint  reduction  (52  percent 
of  the  survey  respondents  identified  this  as  a  barrier  in  December  1995;  by  August  1996 
this  figure  dropped  to  19  percent). 

Regulations  hinder  any  changes  to  make  care  more  individualized.  Through  the  continuing 
participation  of  both  facility  and  survey  team  personnel  in  the  Breaking  the  Bonds 
conferences,  this  negative  perception  diminished  (by  June  1996  only  15  percent  of 
respondents  held  this  belief,  a  reduction  by  half  from  the  previous  year). 

Feedback  gathered  after  the  conference  indicated  that  participating  facilities  reported  significant 
changes  in  implementing  permanent  staffing  and  the  use  of  multidisciplinary  team  meetings  that 
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are  two  of  the  basic  approaches  to  individualized  care.  There  has  been  comparatively  less  change 
in  more  equitable  sharing  of  responsibility  for  care  planning  and  in  moving  away  from  task- 
focused  care,  two  foci  targeted  for  future  interventions. 

J  3.6.2.3.2  Georgia 

In  Georgia,  restraints  reduction  efforts  were  initiated  through  HCFA  Region  IV  with  the 
cooperation  of  the  State  survey  agency.  The  Georgia  Nursing  Home  Association  (GNHA)  has 
taken  a  lead  in  continuing  efforts  to  further  reduce  restraints  use.  Initially,  the  State,  in  meetings 
with  the  different  groups,  encouraged  and  supported  efforts  to  decrease  the  restraint  use  to  14 
percent  through  November  1996.  Presently,  GNHA  has  as  its  next  target  a  reduction  to  5  percent. 

Key  points  to  efforts  undertaken  have  been:  efforts  to  bring  key  players  together  and  keep  them 
involved  in  the  work  groups,  presentation  of  persuasive  data  that  provokes  people  to  act, 
willingness  of  several  representatives  (usually  HCFA  regional  staff)  to  initially  take  the  lead;  and 
the  willingness  of  the  State  to  relinquish  leadership  to  another  agency. 

The  Director  of  Regulatory  Services  at  the  GNHA  wrote  letters  to  all  member  facilities  initially  in 
April  of  1993  referring  to  the  available  OSCAR  data  that  facility  use  of  restraints  was  at  32 
percent.  Multiple  and  repeated  educational  interventions  were  undertaken  with  registered  nurses, 
licensed  practical  nurses,  and  certified  nursing  assistants.  Written  materials  provided  through 
HCFA,  the  National  Citizens  Coalition  for  Nursing  Home  Reform,  and  State  ombudsman  offices 
were  distributed  to  facility  personnel  and  to  families.  Written  and  video  educational  interventions 
have  been  lepeated  at  least  annually.  The  Director  of  Regulatory  Services  at  the  GNHA  has 
annually  sent  a  letter  to  each  facility  comparing  its  use  of  restraints  to  other  facilities.  Facilities 
competed  with  each  other  to  decrease  use  of  restraints,  and  the  results  were  promoted  at  the  two 
association  conferences  held  annually.  Facilities  reducing  restraint  rates  below  10  percent  were 
awarded  certificates,  and  those  that  are  restraint  free  have  been  recognized.  Anecdotal  data  from 
the  facilities  indicate  that  there  was  an  accompanying  decrease  in  the  prevalence  of  pressure  ulcers 
and  in  resident  incontinence  and  an  increase  in  the  numbers  of  resident  falls  without  serious  injury. 
Summary  data  on  numbers  of  affected  residents  have  not  been  collected.  The  capabilities  of 
residents  to  participate  more  actively  in  activities  of  daily  living  were  also  reported. 

The  rate  of  restraints  use  was  25.58  percent  in  April  1994,  and  had  dropped  to  13.6  percent  in 
April  1997.  The  decline  in  the  restraints  rates  seems  to  be  accurate  as  validated  by  available 
HCFA  data;  however,  whether  this  decline  is  directly  attributable  either  partially  or  entirely  to  the 
efforts  undertaken  by  the  GNHA  has  not  been  proven.  A  similar  decline,  in  some  cases  just  as 
dramatic,  has  occurred  across  the  nation.  Establishing  a  correlation  would  be  difficult. 
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13.6.3  Current  Holistic/Alternative  Initiatives 

The  Eden  Alternative,  the  Social  Model,  the  Regenerative  Community  Model,  and  the 
Benedictine  Health  System/Health  Dimensions  are  representative  of  quality  improvement 
initiatives  that  are  major  philosophical,  contextual,  and  cultural  overhauls  to  the  existing  medical- 
model  environments  in  nursing  homes.  Philosophically,  each  model  shifts  to  a  holistic  approach 
(in  contrast  to  what  alternative  model  advocates  would  refer  to  as  the  regulatory-driven  context 
that  fosters  dependency  and  dehumanized  resident  care).  The  four  models  advocate  an 
individualized  approach  to  care  so  residents  are  treated  with  dignity  and  consideration  is  given  to 
their  preferences  and  prior-to-admission  lifestyles. 

13.6.3.1     The  Eden  A  Iternative 

The  Bden  Alternative  alters  of  the  nursing  home  environment  and  culture,  however,  it  is  often 
mischaracterized  as  simply  introducing  animals  (dogs,  cats,  fish,  rabbits,  birds)  and  plants  into  the 
home  and  promoting  community  involvement/intergenerational  exchanges  to  make  the  nursing 
home  more  homelike  and  less  institutional.  While  these  indeed  are  a  few  of  the  characteristics 
associated  with  "Edenizing"  a  home,  they  hardly  are  an  exhaustive  explanation  of  the  changes 
made  or  the  shift  in  philosophy  needed  to  implement  this  approach  to  individualized  care.  The 
Eden  Alternative  seeks  to  alleviate  the  isolation  and  feelings  of  helplessness  that  many  nursing 
home  residents  experience  by  integrating  community  involvement  and  focusing  on  meaningful 
activities  that  build  self-esteem.  This  approach  espouses  individualized  care,  which  requires  that 
the  staff,  residents,  and  families  totally  embrace  the  concept  to  "Edenize"  as  it  is  not  a  selective 
process  to  revise  only  one  component  of  resident  care.  Edenization  calls  for  the  staff  to  focus  on 
framing  problematic  situations  from  the  residents'  views,  sharing  responsibility  for  care  planning, 
and  shifting  from  task-focused  care  to  individualized  care.  A  complete  description  of  this 
approach  to  care  could  and  indeed  does  serve  as  the  topic  of  several  books  authored  by  the 
concept's  leader,  William  Thomas,  M.D. 

One  of  Dr.  Thomas'  premises  was  that  the  Eden  Alternative  could  reduce  the  use  of  restraints  and 
associated  costs  of  psychotropic  medications  for  nursing  homes  residents.  In  a  facility 
comparison,  an  Edenized  facility  decreased  the  number  of  medications  that  residents  received 
without  any  detrimental  effects  to  the  residents  and  potentially  positive  effects  on  residents  who 
substituted  an  activity  in  place  of  a  medication  prescribed  to  reduce  agitation.  While  the  data  were 
based  on  a  restricted  comparison  of  facilities,  if  the  costs  savings  from  the  Edenized  facility  were 
projected  to  the  national  pattern  of  prescription  use  of  psychotropic  medications  prescribed  for 
agitation  and  combativeness,  an  estimated  $1.25  billion  could  be  saved  annually.282 
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The  projected  estimates  of  cost  savings  are  only  one  aspect  of  evaluation  of  Edenization. 
Preliminary  effectiveness  studies  based  on  a  small  sample  (n=3)  indicated  that  when  the  Eden 
Alternative  was  implemented  in  three  diverse  facilities,  there  were  no  increases  in  infection  rates, 
falls,  or  severity  of  falls.283  The  expected  increases  in  resident  satisfaction  were  not  statistically 
significant  across  the  three  facilities.  But,  this  finding  may  have  been  influenced  by  the  time  of  the 
administration  of  the  resident  satisfaction  questionnaire.  It  was  possible  that  the  residents  had  a 
high  rate  of  satisfaction  at  the  time  of  the  first  administration  of  the  questionnaire.  There  were 
statistically  significant  changes  over  time  on  five  of  the  seven  measures  in  the  Nurses'  Observation 
Scale  for  Inpatient  Evaluation  (NOSIE).  There  were  decreases  in  irritability,  manifest  psychosis, 
psychomotor  retardation,  and  depression  in  residents  in  three  facilities  from  the  first  to  second  and 
third  evaluation  administration  which  supported  improvement  over  time.284 

13.6.3.2  Social  Model 

The  Social  Model  optimizes  the  capabilities  of  residents  in  more  home-like,  resident-friendly 
room,  kitchens,  and  dens  that  emphasized  resident  control.  In  each  setting,  staffing  patterns  are 
revised  to  reverse  forced  dependency  (based  on  efficiency)  and  promote  an  environment  that 
supported  independence  in  activities  of  daily  living  and  greater  personal  autonomy.  In  a  facility 
that  has  implemented  the  model,  some  nursing  units  were  transformed  into  "neighborhoods." 
Non-nursing  duties  are  performed  by  resident  assistants,  while  nurses  focus  on  health  care  tasks 
and  nursing  care.  Costs  have  been  incurred  to  remodel  units  with  a  kitchen,  den,  and  furnishings. 
Consumer  satisfaction  and  evaluation  research  is  ongoing  and  was  not  available  to  include  in  this 
report. 

13.6.3.3  Regenerative  Community 

The  Regenerative  Community  model  also  fosters  autonomy  and  individual  resident  participation  in 
daily  community  meetings.  A  facility  that  implemented  this  model  has  encouraged  residents  to 
connect  with  one  another.  The  concept  includes  a  community  developer  who  works  to  develop  a 
community  from  within  with  a  focus  aimed  at  changing  the  culture  of  long-term  care,  empowering 
the  partners  for  shared  objectives,  and  shifting  to  systems  management.  Research  to  evaluate  the 
implementation  of  this  model  is  ongoing. 

13. 6. 3. 4  Benedictine  Health  System/Health  Solutions 

As  noted  in  their  publication,  "the  Benedictine  Health  System  (BHS)  of  Duluth,  MN,  and  Health 
Dimensions,  Inc.,  (HDI)  of  Cambridge,  MN,  developed  an  affiliation  creating  a  new  concept  in 
the  management  and  development  of  extended  care  delivery  systems  Together,  .  .  .  they  now 
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own  and/or  operate  59  health  care  facilities  in  six  states.  These  facilities  include  10  acute  care 
hospitals,  a  rehabilitation  center,  38  nursing  facilities  and  8  assisted  living  facilities,  and  2 
congregate  care  homes."  This  organization  is  included  under  the  chapter  subheading, 
"holistic/alternative  initiatives,"  because  of  its  stated  vision  "...  to  strengthen  the  Catholic  health 
care  ministry  .  .  .  [and]  is  committed  to  the  .  .  .  core  values  of  hospitality,  stewardship,  respect  and 
justice." 

However,  their  quality  improvement  activities  are  much  more  than  philosophical.  There  is  an 
extensive  structure  to  facilitate  assessment  and  data  collection  that  might  argue  for  placing  their 
efforts  under  a  different  heading.  This  structure  consists  of  a  Corporate  Board  that  reviews  the 
outcome  performance  of  each  entity  as  compared  to  standards.  At  the  facility  level,  there  is  a 
Quality  Council/Committee  which  approves  the  Annual  Quality  Plan,  facility-wide  performance 
improvement  initiatives,  and  the  annual  program  evaluation.  Additionally,  it  provides  oversight 
for  the  monitoring  and  evaluation  of  care  and  services  provided  by  departments  and  programs. 
Each  department  has  a  departmental  Quality  Plan  that  consists  of  basic  performance  measurement 
standards.  Finally,  there  is  an  extensive  education  and  training  program,  including  informal 
training  on  an  as-needed  bases,  to  support  the  orientation  of  new  employees  and  to  provide  the 
necessary  mentoring  and  support  to  those  actively  involved  in  improvement  teams. 

This  structure  facilitates  an  extensive  set  of  assessment  and  data  collection  activities,  including 
customer  satisfaction,  occupancy,  staff  turnover  rates,  utilization/case  mix  data, 
grievance/complaint  issues,  regulatory  review  results,  accident/incident  reports,  safety  inspections, 
clinical  outcome  data,  external  comparison  data,  infection  control  data,  mortality  review 
information,  transfer  data,  91 1  usage  data,  equipment  errors,  internally  developed  performance 
measurement  standards,  and  issues  arising  from  day-to-day  operations.  From  these  data  facility- 
wide  quality  control  indicators  are  generated.  Most  of  these  indicators  appear  to  be  generated 
monthly.285  Although  this  collection  of  quality-relevant  data  are  quite  impressive,  we  cannot 
discern  from  the  materials  provided  to  us  from  Health  Dimensions  how  these  data  are  utilized  in 
the  delivery  of  services  nor  whether  they  are  effective  in  improving  resident  outcomes.286 


"Annual  Quality  Plan,"  Health  Dimensions,  1998. 

This  apparent  absence  of  evaluative  data  is  unfortunate.  Clearly,  there  is  an  appreciation  of  the  issues  affecting 
the  long  term  care  industry  in  measuring  and  providing  quality  care.  These  issues,  as  attributed  to  Dale 
Thompson,  are:  "(1)  Information  systems  that  are  well  behind  those  of  acute  care;  (2)  The  newness  of  the 
Quality  processes  and  procedures  within  long-term  care  as  compared  to  acute  care  providers;  (3)  Very  little 
revenue  margins  to  invest  in  the  information  systems  necessary  to  measure  and  track  quality;  (4)  Little 
incentive  under  the  'inspection'  model  currently  in  place  for  surveys,  even  though  the  process  was  changed  in 
1995,  the  focus  on  process  adherence  and  not  clinical  outcomes  is  still  prominent;  (5)  Lack  of  agreed  upon 
definitions  of  'quality'  and  outcomes  m  long  term  care.  This  is  especially  true  for  clinical  outcomes.  The 
clinical  issues  in  long  term  care  mirror  chronic  disease  management  initiatives  which  are  currently  in 
development."  Personal  communication  to  Marvin  Feuerberg  from  Mary  Jo  Graham  RN,  MS,  Director  of 
Research  and  Clinical  Development,  Health  Dimensions  Consulting  Group,  May  20,  1998. 
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13.6.4  Data  Initiatives  and  Survey  Process  Modification 

13. 6. 4. 1     South  Dakota 's  Waiver  Proposal  for  the  South  Dakota  Quality  Initiative 
(SDQI) 

At  the  request  of  the  governor,  the  South  Dakota  Department  of  Health,  Office  of  Health  Care 
Facilities  Licensure  and  Certification,  and  Department  of  Social  Services  began  working  with 
AHCA  in  1996  to  develop  "an  alternative  survey  process  for  nursing  facilities  which  would  ensure 
compliance  with  regulations  and  improve  the  quality  of  care  for  nursing  facility  residents."287  This 
project  was  entitled  the  South  Dakota  Quality  Initiative  (SDQI).  South  Dakota  felt  that  it  had 
several  advantages  to  offer  in  acting  as  a  test  State  for  a  new  system;  namely,  a  "generally 
congenial"  relationship  between  nursing  homes  and  the  State  survey  agency;  the  small  number  of 
surveyors  (18)  and  nursing  homes  (1 16)  in  the  State  (most  of  the  nursing  homes  having  fewer 
than  100  beds);  the  availability  of  the  computerized  resident  assessment  instrument  (RAI) 
information;  and  the  fact  that  South  Dakota  had  started  studying  the  RAI  information  in  the 
format  of  QI  reports.  The  State  stated  that  it  was  interested  in  the  SDQI  because  of: 

"...the  potential  to  help  maximize  the  limited  resources  of  the  State  survey  agency  and  of 
nursing  facilities.  This  could  occur  under  the  alternative  process  by  focusing  more 
regulatory  attention  on  facilities  with  poor  compliance  history[ies]  while  still  ensuring 
adequate  survey  coverage  even  in  those  facilities  with  good  compliance  history [ies]. 
Facilities  would  obtain  technical  assistance  from  the  survey  agency  to  identify  the  root 
cause  of  noncompliance  and  to  predict  poor  resident  outcomes  if  practice  patterns  remain 
constant."288 

To  implement  the  SDQI,  South  Dakota  asked  HCFA  for  a  waiver  of  current  survey  regulations. 
The  meeting  notes  referenced  earlier  gave  some  description  of  how  the  SDQI  would  work  and 
how  the  SDQI  deviates  from  the  current  processes. 

"Rather  than  continuing  to  conduct  a  full  survey  every  12-15  months  in  a  nursing  facility 
which  had  no  deficiencies  cited,  we  [South  Dakota]  will  utilize  surveyor  time  and 
expertise  to  make  frequent  contact  with  nursing  facilities  which  have  not  sustained  the 
corrections  achieved  after  deficient  practice  was  cited.  We  will  provide  technical 


Letter  from  Joan  Bachman,  Administrator  of  the  Office  of  Health  Care  Facilities  Licensure  and  Certification  in 
the  South  Dakota  Department  of  Health,  to  Steven  Clauser,  Director  of  HCFA's  Office  of  Beneficiary'  Program 
Research  and  Demonstration,  dated  April  14,  1997.  The  description  of  the  SDQI  is  derived  from  Bachman's 
notes  from  a  meeting  on  April  1 ,  1 997,  where  HCFA's  Research  and  Demonstration  staff,  Health  Standards 
and  Qualitv  staff,  AHCA,  and  Bachman  discussed  these  issues.  Bachman  attached  the  notes  to  the 
aforementioned  letter. 

Ibid,  p  2  of  notes. 
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assistance  to  facility  staff  to  identify  the  root  cause  of  the  deficient  practice  and  oversee 
implementation  of  new  systems  to  place  the  facility  in  compliance  and  to  sustain  that 
compliance.  The  state  survey  agency  and  the  NF  [nursing  facility]  will  utilize  identical  QI 
reports  to  identify  potential  areas  of  concern,  to  track  facility  practice,  and  to  track 
individual  resident  changes.  SDQI  will  allow  facilities  and  surveyors  to  utilize  in  a 
meaningful  way  the  multitude  of  bits  of  information  that  have  been  gathered  as  a 
requirement  of  an  expensive  federal  regulatory  mandate. 

SDQI  will  place  surveyors  in  much  closer  contact  with  all  NFs  to  identify  problems  or 
potential  problems  at  least  quarterly  rather  than  annually.  In  some  instances,  this  will 
certainly  mean  that  residents  will  be  assured  of  a  higher  quality  of  care  throughout  the  year 
rather  [than]  sporadically  as  under  the  current  process.  SDQI  will  provide  overview  and 
insight  to  regulations  for  facility  staff,  board,  contractors,  and  residents  to  enlarge  the 
team  that  is  working  for  compliance  and  quality."289 

In  the  proposal  for  the  initiative,  South  Dakota  stated  that  surveyors  would  form  two-person 
teams  (STs),  each  with  a  designated  case  load  of  ten  nursing  homes.  These  teams'  reports  would 
be  reviewed  regularly  as  part  of  the  State  survey  agency's  quality  assurance  activity.  The 
individual  nursing  homes  would  appoint  a  quality  assurance  team  "composed  of  persons  with 
decision-making  and  resource  allocation  responsibility"  for  the  facility  that  ideally  would  include 
members  of  the  facility's  interdisciplinary  team.  Each  nursing  home's  quality  assurance  team 
would  work  with  State  surveyors  during  quarterly  consultations  and  an  annual  onsite  validation 
visit  when  surveyors  would  observe  resident  care,  focusing  on  residents'  clinical  outcomes  and 
their  satisfaction  levels.290  AHCA  viewed  the  SDQI's  focus  on  customer  satisfaction  as  an 


Ibid,  p  3  of  notes. 

The  dual  focus  on  clinical  outcomes  as  well  as  customer  satisfaction  is  consistent  with  a  focus  of  the  HCFA 
Quality  Initiative  Team.  Its  February  1 997  report  stated  that,  "Quality  of  care  is  the  extent  to  which  health  care 
and  health-related  services  result  in  desired  outcomes  and  greater  satisfaction  with  care  for  the  populations  and 
individuals  that  we  serve."  The  SDQI  represented  a  quality  improvement  system  that  would  ostensibly  address 
both  clinical  dimensions  of  care  as  well  as  residents'  expectations  for  quality  of  life.  There  have  been 
questions,  however,  about  how  well  approaches  such  as  customer  satisfaction  surveys  work.  The  Nursing 
Home  Law  Letter  article  previously  cited  stated: 

"Customer  satisfaction  surveys  may  provide  little  meaningful  information.  Nursing  facility  residents  may 
overstate  satisfaction  because  of  fear  of  retaliation  or  they  may  be  unable  to  express  their  feelings  because 
of  cognitive  impairments  [footnote  for  Castle,  Nicholas  G.  "Quality  Improvement  in  Nursing  Homes" 
Health  Care  Management:  State  of  the  Art  Reviews  1  (Vol.  3,  No.  1 ,  Nov.  1996)  appears  here  in  the 
text].  Residents  may  have  such  low  expectations  for  care  that  their  "satisfaction"  has  little  significance. 
Satisfaction  also  assumes  choice.  If  patients  have  no  choice  about  their  health  care  provider,  they  may 
'make  do.'  But  resignation  to  the  unavoidable  is  not  satisfaction  in  any  real  sense.  Finally,  even  supporters 
of  customer  satisfaction  surveys  see  them  as  most  useful  in  evaluating  nontechnical  aspects  of  health 
care..."  (p  4) . 
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improvement  on  HCFA's  current  resident  and  family  interview  questions,  both  in  terms  of  the 
frequency  of  administration  and  validity.  The  satisfaction  indicators  were  validated  by  survey 
development  professionals  based  on  interviews  with  residents  as  well  as  families,  and  the 
instruments  were  tested  on  resident  populations. 

The  SDQI  purportedly  would  assess  compliance  with  participation  requirements  using  data  driven 
procedures.  The  data  would  include  monthly  reporting  of  facility  status  on  30  clinical  QIs  that 
were  developed  through  research  conducted  by  CHSRA.  The  monthly  reporting  would  represent 
much  more  frequent  communication  between  the  facility  and  the  surveyors  than  exists  under  the 
present  system.  The  facility  quality  assurance  team  would  be  expected  to  review  the  data  with  the 
surveyors  at  least  quarterly.  Together,  the  survey  team  and  the  facility's  quality  assurance  team 
would  evaluate  data  and  note  potential  compliance  and  quality  improvement  priorities.  Further, 
the  surveyor/staff  group  would  use  data  to  generate  critical  event  reports,  and,  if  applicable,  to 
target,  residents  or  systems  where  potential  intervention  were  required.  Surveyors  would 
participate  with  facility  staff  in  reviewing  data  and  identifying  priority  areas  for  further  study  by 
the  facility's  quality  improvement  team.291  The  survey  team  also  could  provide  input  to  the 
facility's  quality  improvement  team  to  increase  understanding  and  appropriate  implementation  of 
change.  Written  minutes  of  the  meetings  between  the  State  surveyors  and  the  facility  staff  would 
translate  the  identified  issues  into  F-Tags;  however,  findings  would  not  be  recorded  on  the 
HCFA-2567  and  would  not  be  made  public 

State  surveyors  would  have  regular  access  to  updated  information  to  identify  urgent  concerns  and 
to  make  appropriate  contacts  to  the  nursing  home. 

In  spite  of  the  allusions  to  quality  improvement  and  the  inclusion  of  the  factors  identified  within 
the  HCFA  Quality  Initiative  Team's  own  definition  of  quality,  the  SDQI  has  not  been  popular 
with  HCFA  or  national  advocacy  groups  for  several  reasons. 

•         The  abandonment  of  the  HCFA-2567  caused  concern.292  South  Dakota  argued  that 

demand  for  this  information  varies,  and  that  the  nursing  homes  could  offer  their  governing 
body's  quarterly  Quality  Assurance  Report  as  a  substitute.  South  Dakota  indicated  later 
that  it  would  consider  changing  the  initiative  so  that  deficiencies  would  be  written  on  the 
HCFA-2567;  however,  there  is  language  further  along  in  the  same  document  stating  that 
when  surveyors  determined  specific  regulatory  noncompliance,  their  findings  would  then 
be  discussed  with  nursing  home  staff  and  deficiencies  would  be  written  by  the  CQI/TQM 


The  quality  improvement  team  differs  in  that  it  is  composed  of  staff  with  direct  knowledge  of  the  targeted  area 
and  who  represent  diverse  perspectives  in  the  area  to  assure  all  aspects  of  the  targeted  area  are  included  in 
CQI. 

The  HCFA-2567  lists  survey  results  and  provides  an  account  of  the  provider's  plan  of  correction.  This 
document  is  discloseable  to  the  public. 
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team.  It  would  seem  that  the  "CQI/TQM  team"  might  refer  to  the  group  of  facility  staff 
and  the  surveyors,  who  would  collaboratively  write  the  Statement  of  Deficiencies.  Critics 
might  compare  this  to  a  driver  who  is  being  handed  a  traffic  citation  for  being  permitted  to 
write  the  ticket  himself. 

The  partnering  environment  produced  under  the  SDQI  would  reduce  surveyor  objectivity 
and  the  citation  of  noncompliance  and  perhaps  lead  to  collusion.  South  Dakota's  response 
was  that  there  is  already  a  potential  for  collusion,  and  that  since  the  State  is  required  to 
conduct  quality  assurance  of  its  work,  surveyors  would  "require  the  facility  to  obtain 
and/or  maintain  compliance  by  taking  appropriate  corrective  action."  It  is  unclear  what 
"appropriate  corrective  action"  is,  however,  if  that  phrase  refers  to  enforcement  action, 
earlier  comments  made  by  Bachman  seem  to  contradict  the  State's  intention  to  use  this 
approach. 

HCFA  stated  that  the  alternative  process  proposed  in  the  SDQI  could  be  used 
concurrently  with  the  current  survey  and  enforcement  processes  and  stated  that  it  "prefers 
the  State  conduct  a  dual  survey  process  for  its  nursing  facilities."  In  response,  Bachman 
stated,  "South  Dakota  does  not  have  the  necessary  resources  to  conduct  a  dual  survey  of 
nursing  facilities.  Furthermore,  the  entire  concept  of  SDQI  is  collaborative  and  instructive 
rather  than  policing  and  punitive.  These  differences  prohibit  survey  of  a  facility  using  the 
two  opposing  systems..."293 

HCFA  believed  that  the  customer  satisfaction  measures  that  the  SDQI  would  use  were 
untested  and  unreliable.  South  Dakota  argued  that  the  surveyor  interview  of  residents  and 
family  members  that  is  part  of  the  HCFA  survey  has  not  been  tested,  either.  Later 
information  provided  during  interview  for  this  report  suggested  that  the  SDQI  customer 
satisfaction  measures  were  validated  by  survey  development  professionals  based  on 
interviews  with  residents  as  well  as  families,  and  the  instruments  were  tested  on  resident 
populations. 

There  was  concern  that  State  surveyors  would  become  involved  in  the  operation  of  the  NF 
and  would  take  time  away  from  resident  care  and  other  operational  activities.  South 
Dakota  suggested  that  surveyors  would  concentrate  on  measuring  compliance  and  quality 
and  would  not  be  involved  in  operational  aspects  of  the  facility,  however,  in  reviewing 
previous  statements  about  the  surveyors'  role  ("identifying]  root  causes"  of  problems  and 
"oversee[ing]  implementation  of  new  systems"  within  the  facility),  it  would  seem  difficult 
to  draw  a  such  a  distinction. 


Bachman,  p  3  of  notes  attached  to  letter. 


Study  of  Private  Accreditation  (Deeming)  of  Nursing  Homes,  363 
Regulatory'  Incentives  and  Non-Regulatory  Initiatives,  and 
Effectiveness  of  the  Survey  and  Certification  System 


•  QIs  cannot  be  used  to  measure  quality  of  care  or  life  or  regulatory  compliance  since  they 
are  just  now  being  validated  and  tested.  South  Dakota  agreed  with  this  point  and 
explained  that  QIs  would  be  used  to  focus  reviews  and  possibly  identify  problems  or 
potential  problems.  Surveyors  would  continue  to  use  the  available  tools,  such  as  the 
resident  roster,  complaints,  ombudsmen  reports,  and  onsite  visits,  to  monitor  compliance. 

•  South  Dakota  asked  for  permission  to  downsize  the  required  resident  sample  for  the 
annual  survey  of  nursing  homes  that  were  in  substantial  compliance  on  the  last  survey,  had 
no  complaints  filed  against  them,  and  of  which  the  ombudsmen  had  no  complaints,  and 
that  have  not  had  a  change  in  owner  or  management  staff.  The  full  survey  of  such  a  facility 
would  only  be  conducted  every  three  years,  although  it  could  be  conducted  sooner  if  there 
were  indications  of  diminished  compliance. 

•  .  South  Dakota  "asked  permission  to  provide  technical  assistance  to  NFs  [nursing  facilities] 

and  skilled  nursing  facilities  to  incorporate  the  QI  reports  and  the  RAI  into  the  facility 
continuous  quality  improvement  activities  and  to  invoke  regulatory  authority  to  require 
nursing  facilities  to  implement  this  operational  change."  Resident  advocates  might  see  this 
"technical  assistance"  role  as  verging  toward  that  of  a  consultant  rather  than  a  regulator, 
monitor,  and  enforcer.  This  is  a  sticky  point.  In  a  sense,  Task  IX  of  the  current  survey 
process  allows  for  information  transfer  to  further  the  cause  of  better  practice.  Proponents 
for  the  waiver  could  have  argued  that  helping  facilities  figure  out  how  to  use  QI  reports 
would  have  the  same  affect  and  thus  should  also  be  permissible. 

•  South  Dakota  requested  permission  to  "expand  the  entrance  conference  for  one  annual 
visit  to  each  nursing  facility  for  the  purpose  of  reviewing  federal  regulations  and  the 
measures  of  compliance  with  regulations  (survey  process)  for  the  nursing  facility 
employees,  medical  director,  and  contractors;  governing  body  representatives;  and 
resident  representatives.  This  visit  will  be  announced  and  a  standardized  agenda  will  be 
used..."  One  significant  concern  this  brings  up  is  that  traditionally,  surveys  are 
unannounced  (although  ombudsmen  and  other  advocates  indicate  that  for  all  intents  and 
purposes,  surveys  often  are  anticipated  by  the  facilities  due  to  routine  scheduling  habits, 
tip  offs,  or  other  indiscernible  factors.)  It  seems  that  the  SDQI  would  for  some  facilities 
remove  the  annual  survey  and  replace  it  with  a  three-year  cycle;  and  it  might  also  do  away 
with  the  element  of  surprise.  South  Dakota  also  asked  that  it  be  permitted  to  make  site 
visits  and  telephone  contacts  with  nursing  homes  more  frequently  than  contacts  associated 
only  with  annual  surveys  and  complaint  investigations  (the  State  also  asked  that  they  be 
paid  for  these  contacts.) 

South  Dakota's  request  was  not  approved  on  the  basis  that  HCFA  does  not  have  the  authority  to 
waive  any  portion  of  the  survey  process  as  it  relates  to  Medicare-certified  facilities.  AHCA  and 
South  Dakota  argued  that  HCFA  does  have  the  authority  and  pointed  out  that  HCFA  granted 
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approval  to  the  State  of  Kansa  s  for  a  project  in  which  the  required  plan  of  correction  (POC)  for 
nursing  homes  is  waived.294 

HCFA  did  express  a  willingness  to  work  with  South  Dakota  to  develop  special  studies  and 
experiments  which  could  be  conducted  concurrently  with  the  existing  survey  and  certification 
system. 

13. 6. 4. 2  The  New  York  Quality  Assurance  System  (NYQAS) 

NYQAS  was  a  three-year  demonstration  project  (1986  to  1990)  supported  by  HCFA  that  utilized 
a  case-mix  reimbursement  method  (Resources  Utilization  Groups  (RUGS-II))  for  Medicaid 
payments  to  nursing  homes.  New  York  developed  a  method  to  monitor  and  assure  quality  that 
was  linked  directly  to  the  payment  system  as  the  case  mix  payment  system  could  potentially  create 
a  disincentive  to  good  care.296  Two  NYQAS  programs,  the  Data  Share  Program  and  the  Best 
Practices  Program,  were  early  efforts  to  use  feedback  and  positive  reinforcement  to  improve  care. 
The  Data  Share  Program  was  an  opportunity  for  facilities  to  contribute  facility  specific,  MDS- 
type  data  that  were  gathered  as  part  of  a  periodic  resident  assessment.  These  data  were 
aggregated  and  analyzed  and  provided  to  the  facility  in  a  report  that  gave  an  impetus  to  some 
facilities  to  revise  their  practices  and  services. 

13. 6. 4. 3  The  Wisconsin  Quality  Assurance  Project  (QAP) 

Wisconsin  implemented  a  QAP  in  1978-82  that  operationalized  principles  of  CQI  in  the  regulatory 
survey  system  by  encouraging  surveyors  to  expand  their  roles  as  change  agents  to  promote 
process  improvement.297  The  project  demonstrated  that  external  quality  assurance  (i.e.,  the 
regulatory  survey)  of  facility  performance  was  still  necessary  and  that  the  use  of  sanctions  was  an 
important  motivation  for  improvement.  According  to  Gustafson,  the  project  also  demonstrated 
that  procedures  including  statistical  sampling,  improved  partnerships  with  providers,  the 
development  of  improved  measures  of  quality,  and  the  search  for  systems-level  problems  could 


After  legal  review  by  the  Office  of  the  General  Counsel,  HHS,  it  was  determined  that  the  Kansas  initiative  ran 
counter  to  the  regulations;  therefore,  HCFA  directed  Kansas  to  stop  the  initiative. 

In  the  article  "HCFA  Retreats  from  Regulatory  Role,"  The  Nursing  Home  Law  Letter  alleges  that  while  HCFA 
has  rejected  the  SDQ1,  it  is  "apparently,  more  quietly,  pursuing  similar  collaborative,  non-regulatory  initiatives 
in  other  states."  The  article  explains  in  a  footnote  that  alternatives  to  the  survey  and  enforcement  processes  are 
being  discussed  and  tested  in  Kansas,  Ohio,  Vermont,  and  Virginia.  In  discussion  with  key  personnel  in 
HCFA's  central  office  Nursing  Homes  Branch,  we  were  unable  to  confirm  the  existence  or  identify  the  nature 
of  the  initiatives  that  the  article  stated  were  going  on  in  three  other  States  (aside  from  Kansas). 

Koren,  1996. 

Gustafson,  1992. 
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lead  to  early  detection  and  correction  of  problems  and  could  at  the  same  time  contribute  to 
reducing  costs  of  the  survey  process. 

1 3. 6. 4. 4  The  Health  Care  Quality  Improvement  Program  (HCQIP) 

HCFA's  HCQIP  primarily  involves  peer  review  organizations'  (PROs)  collaborative  efforts  to 
collect  data  about  certain  outcomes  or  conditions,  then  supply  that  data  to  caregivers  for  quality 
improvement.  HCQIP  efforts  have  also  focused  on  collaborative  efforts  such  as  increasing  flu 
immunization  rates  for  the  elderly.  Typically,  the  PROs'  work  has  been  performed  in  the  acute 
care  setting  rather  than  in  the  nursing  home  environment. 

1 3. 6. 4. 5  The  Multistate  Nursing  Home  Case  Mix  and  Quality  (NHCMQ) 
Demonstration 

This  demonstration  project  utilizes  MDS  data  to  develop  a  patient  classification  system  that 
adjusts  for  case  mix  that  can  be  used  by  both  Medicare  and  Medicaid  for  prospective  payment  for 
nursing  home  care.  Five  States  participate  in  this  demonstration:  Maine,  New  York,  South 
Dakota,  Mississippi,  and  Texas.  Case  mix  payment  systems  have  a  potentially  perverse  incentive 
for  poor  care  because  higher  payment  usually  results  when  patients  are  sicker  and  more 
debilitated.  In  order  to  monitor  this  problem,  as  well  as  to  assist  surveyors  in  the  survey  and 
providers'  internal  quality  assurance  efforts,  a  Quality  Monitoring  System  (QMS)  has  been 
developed.  The  QMS  being  tested  in  the  NHCMQ  demonstration  incorporates  the  use  of  QIs 
(QIs)  into  the  Federal  survey  and  certification  process.  The  QIs  are  derived  from  items  on  the 
Minimum  Data  Set  Plus  (MDS+),  the  assessment  tool  used  by  all  long-term  care  facilities  in 
demonstration  States  for  resident  assessment,  care  planning,  and  casemix  adjustment  of  Medicare 
and  Medicaid  payment  rates. 

The  QIs  are  used  in  the  QMS  as  a  mechanism  for  surveyors  to  gather  information  about  the 
facility  and  its  residents  prior  to  conducting  an  onsite  survey.  A  set  of  facility  and  resident  level 
prototype  report  formats  were  created  by  CHSRA  These  reports  were  intended  to  enable 
surveyors  to  determine  how  a  given  facility  compares  to  its  peers  as  decisions  are  made  about 
areas  of  care  to  target  during  the  survey,  which  residents  to  include  in  the  review  sample,  and 
perhaps  what  types  of  specialty  surveyors  should  accompany  the  survey  team.  The  QIs  may  also 
be  used  to  identify  facilities  with  potential  care  problems  that  are  more  prevalent  than  in  peer 
group  facilities.  The  QIs  could  be  used  to  target  facilities  for  more  scheduling  more  frequent 
surveys  or  special  monitoring  activity. 

In  addition  to  providing  reports  to  State  surveyors,  CHSRA  also  created  reports  for  facilities  that 
can  be  run  and  disseminated  periodically  for  use  as  performance  improvement  tools.  These 
reports  identify  care  areas  and  residents  that  "flag"  certain  QIs  and  provide  comparisons  to  peer 
group  facilities.  The  independent  evaluation  contractor  for  this  project,  Abt  Associates,  reports 
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that  for  the  three  States  that  were  using  the  QIs  in  the  survey,  all  facilities  that  were  participating 
in  the  payment  component  of  the  demonstration  had  received  at  least  one  QI  report. 

Under  subcontract  to  Abt  Associates,  the  University  of  Colorado  (UC)  will  conduct  staged 
quality  of  care  surveys  in  demonstration-participating  and  non-participating  facilities.  Though  the 
QMS  developed  by  CHSRA  has  not  been  implemented  in  all  demonstration  States,  the  UC 
surveys  will  be  conducted  to  determine  whether  variation  exists  in  the  ability  of  surveyors  to 
detect  quality  problems  in  States  where  the  QIs  are  utilized  versus  in  States  where  they  are  not. 
This  evaluation  component  will  be  conducted  between  March  and  late  June  1998,  with 
preliminary  findings  expected  to  be  available  by  December  1998. 

13. 6. 4. 6    State  of  Washington 's  Quality  Assurance  Nurses  (QANs) 

The  Slate  of  Washington's  Division  of  Residential  Care  Services,  Aging  and  Adult  Service,  has 
approached  the  task  of  information  dissemination  (Task  IX  of  the  survey  process  as  detailed  in  the 
SOM)  by  implementing  a  multi-faceted  quality  assurance  project  that  uses  QIs,  information 
exchange,  information  distribution  methods,  and  data  accuracy  reviews  in  addition  to  assessment 
functions  performed  by  Quality  Assurance. Nurses  (QANs).  This  ongoing  effort  represents  an 
attempt  by  the  State  to  maintain  its  regulatory  (survey  and  enforcement)  activities  while  increasing 
its  focus  on  quality  improvement  through  information  exchange  between  the  State  survey  agency 
and  facilities.  The  statewide  project  is  intended  to  improve  facility  residents'  quality  of  care  and 
quality  of  life,  as  well  as  to  promote  and  facilitate  quality  improvement  efforts  within  the  agency 
and  the  long-term  care  facility.  The  provision  of  information  as  a  separate  function  from  the 
survey  process  is  supported  by  the  HCFA's  SOM,  which  indicates  that  information  transfer  is  a 
function  at  the  discretion  of  the  State  and  can  be  performed  at  various  times  including  during  the 
standard  survey,  during  follow-up  or  complaint  surveys,  during  conferences  or  workshops,  or  at 
another  time  mutually  agreeable  to  the  survey  agency  and  facility. 

One  component  of  the  multi-faceted  approach  to  reaching  the  aforementioned  goals  is  the  use  of 
QANs  to  do  field  protocol  visits  to  assigned  facilities  on  a  regular  basis,  usually  quarterly.  The 
QANs  do  a  basic  review  of  systems,  verify  accuracy  of  MDS  assessments  and  data,  and  provide 
regulatory-based  information  exchange  to  assist  the  facility  staff  to  improve  quality.298  Information 
exchanges  between  the  QAN  and  facility  staff  focus  on  MDS  data,  QI  reports,  and  identification 
of  areas  of  resident  care  where  the  facility  possesses  strengths  or  weaknesses.  The  role  of  the 
QAN  is  to  explain  to  the  staff  what  a  regulation  requires,  how  it  is  reviewed  on  survey  visits 
(following  the  Federal  guidelines),  and  how  compliance  will  be  evaluated;  however,  the  QAN 
does  not  consult  with  the  facility  on  actions  to  take  to  address  an  issue.  The  QANs  are  trained  to 
present  the  information  from  the  MDS/QI  reports,  but  they  do  not  give  the  facility  personnel 
advice  on  how  to  fix  a  problem.  QANs  explain  the  regulatory  requirements  and  how  observations 


Jessup,  1997 
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would  lead  to  conclusions  about  compliance  with  a  requirement.  Following  specific  protocols, 
each  QAN  asks  staff  questions  regarding  the  risk  factors,  appropriateness  of  plans,  types  and 
causes  of  problems,  and  physician  involvement.  The  QAN  leaves  the  copy  of  the  report  of  this 
activity  with  the  facility,  which  benefits  the  provider  by  validating  best  practices  and  identifying 
exemplary  practices  and  problem  areas.  The  QAN  provides  the  information  gathered  through  the 
protocols  in  an  electronic  format  that  the  facility  can  readily  access.  The  QAN  makes  it  clear  to 
the  facility  that  information  that  is  supplied  is  regulatory-based  and  MDS-derived  assessment 
information.  Response  to  the  information  is  left  entirely  to  the  facility. 

While  the  QAN  does  not  consult  or  make  any  specific  recommendations,  he  may  inform  one 
facility  that  a  different  facility  may  be  implementing  care  or  services  using  other  approaches.  This 
creates  the  option  for  that  facility  to  contact  the  other  facility,  perhaps  disseminating  best 
practices  ore  related  information  between  facilities.  A  separate  opportunity  exists  to  disseminate 
information  through  regularly  scheduled  meetings  of  the  two  statewide  nursing  home  associations 
with  the  State  survey  agency  representatives.  During  this  meeting,  participants  might  identify 
promising  approaches  or  practices,  leading  to  further  exchange  of  information. 

The  QAN  reports  his  or  her  findings  to  the  State  survey  agency's  quality  database.  The  findings 
may  be  used  to  target  survey  resources  and  activities.  The  State  survey  team  can  access  QAN 
reports  on  facilities  and  use  that  information  as  part  of  the  pre-survey,  offsite  planning  for  the 
annual  survey. 

The  QANs  perform  their  information  dissemination  task  separately  from  the  survey  process.  The 
30  QANs  are  all  trained  as  surveyors,  and  they  exchange  their  QAN  roles  for  surveyor  roles  and 
participate  as  survey  team  members  on  6  to  8  surveys  annually.  The  QAN  functioning  as 
information  disseminator  does  not  simultaneously  function  as  a  surveyor.  Should  they  assess  that 
a  situation  warrants  it,  the  QANs  may  cite  a  deficiency,  but  this  situation  is  rare. 

As  implemented  in  Washington  State,  this  approach  also  includes  the  use  of  protocols.  The  QANs 
refer  to  the  protocols  (structured  procedures  to  collect  detailed,  resident-specific  data  and  to 
analyze  the  accuracy  and  validity  of  the  nursing  assessment)  during  their  visits,  which  ensures  that 
each  QAN  uses  a  structured,  uniform  procedure.  The  content  areas  of  the  protocols  correspond 
to  three  sources:  (1)  the  outcome  indicators  developed  by  CHSRA;  (2)  MDS  data  elements;  and 
(3)  regulatory  F  Tags.  The  protocols  are  applied  to  a  sample  of  residents  at  risk  for  a  specific 
condition  (e.g.  Injury  Prevention  Protocol,  Skin  Integrity  Protocol).  The  completion  of  the 
protocol  would  yield  a  pattern  that  could  describe  a  system  or  a  practice  in  the  nursing  home. 
Depending  on  results  of  the  protocol,  the  present  system  that  the  facility  is  using  may  be  affirmed 
as  appropriate  to  produce  desired  resident  outcomes.  Problem  areas  involving  one  or  more 
systems  may  be  identified  early  for  corrective  actions  before  they  become  more  widespread  in 
nature. 
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The  success  of  a  quality  improvement  initiative  that  uses  a  QAN  or  a  similarly  prepared 
professional  depends  in  part  on  accurate  computerized  MDS  data.  The  State  of  Washington  has 
used  a  computerized  MDS  for  more  than  six  years,  having  initially  used  the  MDS  version  1.0,  and 
now  version  2.0.  Implementation  of  this  quality  improvement  initiative  identified  several  reasons 
that  accounted  for  facilities  reporting  higher-than-the-State  average  on  various  elements  of  the 
MDS.  There  were,  of  course,  a  share  of  system  problems  in  some  facilities  and  data  entry 
problems  in  others,  but  in  some  cases,  the  facility  staff  was  actually  doing  a  thorough  job  in 
assessing  the  status  of  residents.  The  higher-than-average-MDS  data  may  not  have  actually  been 
an  indicator  of  true  system  problems,  but  of  improvement  in  recognizing  conditions  and 
developing  and  implementing  interventions. 

The  functions  of  the  QAN  are  very  similar  to  the  data  share  model  for  integrating  quality 
improvement  in  the  survey  process  as  presented  by  Koren  (1996)  at  the  QAAS.  A  QAN  or  a 
counterpart  serving  in  a  similar  role  performs  the  duties  of  information  exchange  and  increases  the 
frequency  with  which  a  representative  of  the  State  survey  agency  has  the  opportunity  to  view  and 
assess  the  conditions  in  a  nursing  home.  Any  assessment  of  facilities  at  a  frequency  that  is  more 
often  than  an  annual  survey  should  serve  as  a  means  of  identifying  actual  or  potential  areas  of 
resident  care  or  facility  practices  that  require  further  assessment  and  intervention.  Ultimately,  all 
other  things  being  equal,  more  frequent  assessment  should  lead  to  improvement  in  the  quality  of 
services  that  are  provided. 

13. 6. 4. 7    Quality  Measurement  Projects  in  Mississippi  and  Ohio 

The  MDS-derived  QIs  developed  by  CHSRA  were  pilot  tested  in  Mississippi  and  Ohio  using  the 
Facilitator  quality  management  software  and  network  tool.  Data  collection  in  Ohio  was  performed 
from  July  1996  through  July  1997  There  were  32  indicators  in  12  domains  that  were  reduced  to 
24  indicators  for  the  potential  presence  or  absence  of  poor  care  practices  or  outcomes  (e.g. 
weight  loss,  pressure  ulcers,  falls,  depression).  The  goals  were  to  use  QIs  and  to  collect 
satisfaction  data  to  improve  quality  of  life  and  the  quality  of  clinical  care.  The  provision  of  facility 
specific  and  peer  facilities  comparison  data  generated  interest  and  motivated  facilities'  personnel 
to  alter  their  practices,  which  was  reported  by  an  AHCA  representative  to  have  a  significant  effect 
on  outcomes.  In  the  Ohio  pilot  study  of  55  facilities,  significant  improvements  were  reported  in 
several  measures  (e.g.,  injuries,  bedfast  residents,  restraints)  and  improvements  occurred  in  other 
QIs  (tube  feeding,  hypnotics  use).  The  pilot  study  demonstrated  that  not  all  facilities  could 
effectively  and  concurrently  work  on  a  large  number  of  QIs;  this  result  suggested  that  a  strategy 
to  improve  performance  should  be  focused  on  a  selected  number  of  QIs. 

The  Ohio  study  could  build  on  the  earlier  Quality  Indicators  Index  and  Education  (QUIIX-Ed) 
Project  that  was  initiated  in  nine  nursing  facilities  in  Mississippi  in  1994  The  QUIIX-Ed  Project, 
initiated  by  AHCA,  tested  QIs  that  addressed  clinical  and  functional  care  outcomes  and  facilitated 
nursing  homes'  ability  to  compare  their  data  to  aggregated  data  on  peer  nursing  homes.  Facility 
personnel  were  more  interested  in  comparing  their  performance  to  peer  group  facilities  than  to  a 
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statewide  group  of  facilities.  Evidence  provided  in  a  report  of  the  QUIIX-Ed  Project  stated  that 
representative  facilities  improved  in  clinical  outcome  measures  (e.g.,  decrease  of  bedfast  residents 
from  24  percent  to  10  percent  as  a  result  of  intervention,  number  of  residents  free  of  restraints 
increased).  The  projects  educated  providers  to  use  QIs  and  to  exchange  educational  materials  on 
effective  practices. 

The  Association  of  Ohio  Philanthropic  Homes,  Housing,  and  Services  for  the  Aging  implemented 
a  Quality  Care  Indicator  Program  and  Pathway  Monitoring  Program  in  February  1996.  That 
program  directed  facilities  to  use  a  framework  that  was  consistent  with  survey  process  in  order  to 
systematically  and  proactively  improve  quality  of  care  to  residents  and  improve  service  delivery. 
The  Quality  Care  Indicator  Program  provides  information  to  a  facility  about  its  performance  as 
compared  with  other  facilities.  The  program  measures  the  facility's  performance  in  12  care 
domains  with  related  assessment  of  risk  factors.  The  domains  are  those  derived  by  the  CHSRA 
group  and  use  the  MDS  as  the  data  source.  The  program  identified  both  process  related  issues 
(e.g.  prevalence  of  restraints)  and  outcome  issues  (e.g.  incidence  of  pressure  ulcers).  The  Quality 
Care  Indicator  Program  alerts  the  facility  personnel  to  process  and  outcome  issues  early  and 
frequently  so  they  can  take  corrective  action  if  needed.  Furthermore,  the  use  of  the  program 
would  provide  a  validation  of  the  quality  of  services  that  is  increasingly  becoming  of  interest  to 
third  party  payors  (e.g.  managed  care  organizations). 

13.7     How  Effective  Are  Quality  Improvement  Initiatives? 

13.7.1  Judging  Effectiveness 

The  immense  variety  of  the  aforementioned  quality  improvement  initiatives  make  it  difficult  to 
evaluate  their  effectiveness.  Given  this  variety,  an  appropriate  criterion  forjudging  effectiveness 
it  is  not  readily  apparent.  As  noted  earlier,  some  of  these  quality  improvement  efforts  are 
essentially  a  loosely-related  bundle  of  well-intentioned  initiatives.  In  keeping  with  terminology 
conventional  in  evaluation  research,  we  characterize  some  of  these  initiatives  as  "interventions," 
particularly  when  the  component  activities  of  a  quality  improvement  initiative  are  clearly  defined. 

Another  useful  distinction  in  evaluation  research  is  between  formative  and  summative 
evaluations  299  Formative  evaluations  address  the  need  for  useful  information  by  program 
administrators  as  they  develop  and  implement  "real  world"  programs  Normally  this  involves  the 
development  of  a  bundle  of  often  loosely-related  activities  that  are  intended  to  improved  a  number 
of  outcomes  of  interest  which  themselves  may  be  loosely  defined  or  not  even  fully  recognized. 
Commonly,  programs  (activities,  initiatives)  do  not  automatically  emerge  suddenly  full-blown 
suitable  for  immediate  implementation  and  evaluation.  There  is  often  a  developmental  phase 


See  LawTence  B.  Mohr,  Impact  Analysis  For  Program  Evaluation,  Sage  Publications,  2nd  edition,  1995,  for  a 
discussion  of  this  distinction  and  related  evaluation  issues. 
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followed  by  or  iterative  with  incremental  implementation  As  this  process  unfolds,  some  activities 
are  viewed  as  unhelpful,  others  are  modified,  and  objectives  are  modified.  During  this  process 
there  is  a  need  for  systematic  information  to  guide  these  modifications.  Hence,  the  need  for  a 
formative  evaluation: 

If  the  program  turns  out  to  have  failed  or  fallen  short  [in  meeting  its  outcome 
objectives]....,  formative  evaluation  may  attempt  to  answer  the  question,  Why7  If  the 
program  succeeds  in  some  measure,  formative  evaluation  may  attempt  to  answer  the 
question,  Were  all  of  the  activities  necessary,  or  were  some  dispensable7  These 
responsive  functions  are  accomplished  by  observing  sub-objectives  and  activities,  as  well 
as  the  outcome  of  interest.  The  sub-objectives...  are  outcomes  that  must  be  achieved  so 
that  the  outcome  of  interest  may  be  achieved.  If  it  is  known  that  one  or  more  sub- 
objectives  were  not  attained,  a  weakness  may  thereby  be  pinpointed ...  In  this  fashion,  the 
program...  is  tested  and,  if  necessary,  amended.300 

As  will  be  shown  below,  many  of  the  quality  improvement  initiatives  described  in  this  chapter  are 
at  a  stage  of  development  that  may  be  suitable  for  a  formative  evaluation,  although  we  have  no 
information  about  whether  formative  evaluations  have  or  will  be  conducted.  More  important  for 
the  purposes  of  this  chapter  is  the  question  of  whether  there  is  evidence  that  the  initiatives  have 
achieved  their  objectives.  That  is,  ultimately  we  need  summative  evaluations  to  determine  the 
program's  impact,  usually  with  a  research  design  that  controls  for  extraneous  variables  that  could 
lead  to  a  misinterpretation  of  the  true  impact  of  the  program.  Ideally,  evaluations  combine  both 
formative  and  summative  objectives.  As  was  shown  in  previous  sections,  some  have  argued  that 
quality  improvement  initiatives  could  replace  or  supplant  elements  of  the  survey.  If  implemented, 
this  serious  a  change  could  only  be  warranted  by  very  strong  supportive  evidence  from  a 
adequately  designed  summative  evaluation.  As  will  be  shown  below,  such  evidence  is  totally 
absent 

13.7.2  Evidence 

Rather  than  presenting  a  lengthy  list  of  all  the  projects  discussed  in  this  section  and  the  appendices 
together  with  relevant  evidence,  we  think  it  more  helpful  to  organize  an  assessment  of  evidence 
around  categories  arrayed  in  order  of  the  strength  of  the  evaluation  "design,"  such  as  it  is,  and  the 
strength  of  supportive  or  non-supportive  evidence.  Within  each  category  we  refer  to  either 
illustrative  initiatives  or  to  the  most  important  project.301 


Ibid,  p.  33 

Some  caution  is  warranted  here  As  was  noted  earlier,  this  chapter  is  derived  from  a  report  of  our  contractor, 
Margaret  McKenna,  who  in  turn  analyzed  information  from  key  informant  interviews  and  reviews  of  available 
reports  and  working  documents  It  is  quite  possible  that  there  are  reports  that  did  not  come  to  the  attention  of 
our  contractor  or  there  is  now  new  information  that  became  available  sometime  alter  the  December  22,  1 997 


Study  of  Private  Accreditation  (Deeming)  of  Nursing  Homes,     37 1 
Regulatorv  Incentives  and  Non-Regulatory  Initiatives,  and 
Effectiveness  of  the  Survev  and  Certification  System 


13.  7. 2. 1     Proposed  Quality  Improvement  Initiative  -  No  Implementation 

At  one  extreme  we  can  find  a  reasonably  developed  proposal  of  a  quality  improvement  initiative, 
the  South  Dakota  Quality  Initiative,  which  has  not  been  implemented  because  of  HCFA 
opposition  for  a  number  of  reasons  discussed  above.  Under  these  circumstances,  there  is  no 
evidence  to  assess.  Similarly,  the  National  Restraint  Reduction  Initiative  has  only  been  partially 
implemented  in  many  Regions. 

13.  7. 2. 2     Quality  Improvement  Initiative  Implemented  -  No  Evaluation 

Most  of  the  quality  improvement  initiatives  probably  fit  into  this  category.  Something  has  been 
implemented,  but  to  our  knowledge  no  evaluation  is  planned  The  Restraint  Reduction 
Workgroup,  Nursing  Home  Restraint  Reduction-Production  and  Dissemination  of  Family  Video, 
Training-Nursing  Home  Restraint  Reduction,  Iowa  Partners  for  Resident  Care,  Washington  State 
Information  Exchange  Workgroup,  and  numerous  others  listed  in  the  Appendix  H  fit  this 
category.  Closely  related  are  those  initiatives  for  which  an  independent  evaluation  is  purportedly 
planned  -  e.g.,  the  Social  Model  or  the  Regenerative  Community  -  but  no  data  were  available  at 
the  time  the  contractor's  report  was  written.  Finally,  there  is  the  Multistate  Nursing  Home  Case 
Mix  and  Quality  Demonstration  or  the  six  PROs  pressure  ulcer  projects,  described  above,  all  of 
which  have  implemented  an  evaluation,  but  no  or  very  few  preliminary  results  are  available.302 


date  of  the  contractor's  report. 

Abt  Associates,  "Description  and  Evaluation  of  the  Quality  Monitoring  System,  "  preliminary  interim  results 
from  a  draft  report  to  HCFA,  February'  2,  1 998.  Abt  Associates,  the  independent  evaluation  contractor  for  this 
demonstration,  summarized  the  preliminary  interim  results  as  follows: 

.   .  the  facilities  in  states  that  used  the  QIs  in  the  survey  process  reported  that,  in  general:  1 )  the  QI 
reports  often  were  old  and  not  relevant;  2)  most  staff  did  not  detect  a  significant  change  in  how  the 
survev  process  was  conducted  based  on  the  QIs;  3)  how  surveyors  use  the  QIs  in  the  survey  process 
varied  bv  state  and  survev  team;  4)  the  QIs  were  not  perceived  as  improving  the  detection  of  quality 
problems  in  the  survey  process;  5)  there  was  still  a  significant  level  of  surveyor  inconsistency  and 
subjectivity  m  the  survev  process  perceived  by  providers  interv  iewed;  and  6)  there  continues  to  be 
concern  about  the  accuracy  of  the  MDS  and  the  QIs  generated  from  them.  Providers  did  report  value 
in  incorporating  the  QIs  into  their  internal  quality  assurance  activities  and  were  doing  so  in  many 
cases. 

It  should  be  noted  that  although  these  interim  results  are  not  encouraging  with  respect  to  how  the  MDS  QFs 
could  assist  surveyors  to  improve  the  survey  process,  the  evidence  so  far  presented  here  consists  of 
participating  providers'  perceptions.  Although  provider  perceptions  may  be  an  important  element  in  the 
success  of  the  demonstration,  it  is  not  a  substitute  for  independent,  objective  evidence  of  the  utility  of  the  QIs. 
As  noted  above  in  section  13.6.4.5,  this  issue  will  be  examined  by  University  of  Colorado  (UC)  under 
subcontract  to  Abt  Associates. 
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1 3.  7. 2. 3     Quality  Improvement  Initiative  Implemented  -  Weak  Evaluation 


•  Eden  Alternative  -  An  evaluation  was  conducted  to  study  the  impact  of  the  Eden 
Alternative  for  three  New  York  State  nursing  homes  during  a  three  year  period,  1 994- 
1996. 303  This  was  an  inherently  weak  evaluation  design,  essentially  a  pre-post-design 
looking  at  changes  in  the  Edenized  nursing  homes  with  no  control/comparison  group  that 
did  not  receive  the  Eden  interventions.  This  design  was  further  weakened  by  the  use  of 
measurement  instruments  -  resident  and  staff  satisfaction  indexes  and  a  nurses  observation 
scale  measuring  positive  and  negative  patient  behavior  -  that  were  implemented  pre- 
implementation  of  the  Eden  program  in  only  one  of  the  three  facilities.  For  two  of  the 
three  facilities  these  measures  the  comparison  is  really  post-Eden  with  post-post-Eden. 

In  general,  the  results  of  changes  in  the  various  questionnaire  instruments  were  not  encouraging: 
there  were  no  statistically  significant  changes  over  time  on  any  of  the  general  Life  Satisfaction 
Index  scores  or  for  Eden-specific  items  for  any  of  the  facilities;  more  discouraging  were  the 
resident  satisfaction  scores  that  indicated  a  statistically  significant  decline  on  one  measure. 
Although  statistically  significant  improvement  was  reported  on  5  of  7  resident  behavioral 
measures,  the  data  were  derived  from  40  percent  of  the  resident  population  as  completed  by 
nursing  personnel,  hence,  this  inherently  subjective  data  are  the  product  of  (non-independent) 
observers  who  are  likely  to  have  an  interest  in  the  outcome  of  the  evaluation. 

Finally,  the  limitation  of  subjective  data  and  an  incomplete  pre-post  data  are  partially  addressed  by 
a  record  review  that  was  conducted  on  all  three  facilities.  As  noted  by  the  evaluators: 
"Proponents  of  Eden  have  suggested  that  Eden  results  in  decreased  numbers  of  medications  being 
ordered,  decreased  costs  of  medication,  reduced  mortality,  reduced  staff  turnover,  while  having 
no  negative  impact  on  (increasing)  infection  rates  or  severity  or  number  of  falls."  As  noted  again 
by  the  evaluators,  "the  major  outcome  variables  of  medication  order  and  costs,  mortality  rates, 
staff  turnover,  infection  rates,  falls,  and  serious  falls  did  not  show  statistically  significant  changes 
over  time."  In  other  words,  the  expected  good  outcomes  (e.g.,  reduced  mortality  or  staff 
turnover)  did  not  occur.  In  summary,  this  was  an  extremely  weak  evaluation  design  that 
produced  essentially  no  to  very  weak  supporting  evidence  for  the  Eden  Alternative. 

•  Connecticut  and  Georgia  Physical  Restraint  Reduction  Initiatives  -  In  Connecticut,  the 
key  initiative  or  intervention  appears  to  be  the  Breaking  the  Bonds  educational 
conferences  which  were  held  from  late  1994  through  June  1997.  These  efforts  were 
described  in  more  detail  earlier  The  evidence  in  support  of  the  effectiveness  of  the 
initiatives  appears  to  be  a  change  in  perceptions  derived  from  surveys  of  nursing  homes. 
Specifically,  the  perception  of  inadequate  staffing  as  a  barrier  to  promoting  restraint 
reduction  dropped  during  the  initiative.  Similarly,  "the  proportion  of  facility  staff  who  see 


Riesenberg,  L  A.  Eden  Alternative  Research  Report,  August  19,  1996 
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"the  State  as  getting  in  the  way  of  individualized  care  models  has  dropped  steadily  over 
time."  Other  changes  in  perceptions  have  been  marshaled  as  supportive  evidence  of  the 
effectiveness  of  this  initiative.  Clearly,  changes  in  reported  perceptions  are  not  evidence 
for  actual  changes  in  care  practices.  Although  it  is  true  that  independent  OSCAR  data 
indicate  a  decline  in  physical  restraints  from  about  20.4  percent  in  early  1995  to  about 

17.2  percent  in  1996,304  it  is  also  true  that  the  same  data  sources  indicated  a  decline  in 
physical  restraints  for  all  States  combined  from  19.1  percent  to  18.5  percent.  Also, 
several  States  that  were  not  part  of  this  initiative  have  had  a  greater  decrease  in  the  rate  of 
physical  restraints  than  Connecticut.  Even  if  the  decrease  was  greatest  for  Connecticut, 
which  it  is  not,  this  evaluation  design  would  not  permit  us  to  attribute  the  positive 
outcome  to  the  initiative. 

The  Georgia  physical  restraint  reduction  initiative  is  also  described  above  in  more  detail. 
This  initiative  consists  of  essentially  educational  interventions  targeted  to  nursing  staff  in 
member  facilities  of  the  Georgia  Nursing  Home  Association.  The  program  implementors 
reported  a  rate  of  restraints  use  of  25  .58  percent  in  April  1994  which  had  dropped  to  13  .6 
percent  in  April  1997.  In  general,  this  is  consistent  with  the  independent  OSCAR  data 
cited  above  for  all  Georgia  facilities  which  report  a  reduction  in  physical  restraints  from 

24.3  percent  to  14.1  percent  in  1996.  Although  this  is  a  large  reduction,  it  should  be 
noted  that  there  was  a  decline  in  the  national  rate  during  this  period  and  several  States 
have  had  a  decline  as  great  as  Georgia.  For  example,  during  this  same  period  South 
Carolina  declined  from  a  rate  of  26.2  percent  to  14.9  percent    Again,  the  weak  pre-post- 
design  does  not  permit  us  to  assess  the  degree  to  which  we  can  attribute  the  decline  to  the 
intervention,  if  at  all.  Further,  the  definition  of  a  physical  restraint  is  often 
(mis)interpreted,  contributing  to  variability  in  reported  rates  Under  these  circumstances, 
it  is  possible  that  the  combination  of  an  ambiguous  definition  and  awareness  of  increased 
interest  in  this  area  might  contribute  to  a  decrease  in  reported  rates  with  no  real  decrease 
in  actual  rates. 

•         AHCA  'S  Quality  Indicator  Index  and  Education  (QUIIX-Ed)  Project*™  -  This  project  is 
described  in  more  detail  above.  Essentially,  nine  nursing  facilities  in  Mississippi 
volunteered  to  participate  in  this  project  and  receive  monthly  reports  of  their  performance 
on  15  MDS -generated  quality  of  care  indicators.  The  nine  facilities  were  able  to  compare 
their  relative  performance  on  each  indicator  with  the  other  eight  volunteer  facilities,  as 
well  as  the  Mississippi  State-wide  average  performance  of  all  facilities.  Although  the 


Harrington,  C,  et  al.,  Nursing  Facilities,  Staffing,  Residents,  and  Facility  Deficiencies,  1991  Through  1995, 
Table  1 5,  University  of  California,  San  Francisco,  January  1997;  Also,  Cowles,  M.,  S'ursing  Home  Statistical 
Yearbook,  Table  11-10,  Cowles  Research  Group,  1997. 

Fitzgerald,  P.,  Shivenck,  B.,  and  Zimmerman,  D.,  Applying  Performance  Measures  to  Long  Term  Care, 
Journal  on  Quality  Improvement,  July  1996,  V.  22,  No.7,  505-517 
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initiative  had  no  specific  protocols  to  standardize  how  this  performance  information  was 
to  be  incorporated  into  each  facilities  quality  improvement  process,  "...  facility  staff  were 
encouraged  to  reassess  the  specific  residents  affected  by  the  quality  measure  being 
addressed." 

Aggregate  changes  in  the  scores  on  the  1 5  performance  measures  indicated  significant 
improvement  for  six  measures.  While  positive,  the  changes  in  performance  scores  of  the 
vast  majority  of  facilities  that  did  not  participate  in  this  demonstration  was  not  reported. 
Presumably,  the  improvement  was  greater  for  the  participating  facilities  than  the  non- 
participating,  although  even  these  results  could  be  due  to  some  selection  factor 
contributing  to  their  "volunteer"  status.  These  extraneous  factors  unrelated  to  the 
intervention  might  include  motivation  to  improve  and/or  please  the  sponsors  of  the 
project,  AHCA.  Given  that  the  data  are  self-reported,  there  is  always  the  possibility  that 
any  changes  are  simply  reported  changes  of  the  performance  measures. 

13.  7. 2. 4    Ohio  Pressure  Ulcer  Prevention  Initiative  -  Strong  Evaluation 

An  Important  Initiative 

As  part  of  an  experimental  initiative  targeted  at  reducing  pressure  ulcer  incidence  and  prevalence 
in  nursing  homes,  all  111  nursing  facilities  in  the  Toledo,  Ohio  catchment  area  received  feedback 
data  regarding  the  incidence  and  prevalence  of  pressure  ulcers  in  their  facilities  on  a  resident- 
specific  basis,  as  well  as  a  comparison  of  their  facility-wide  rate  of  pressure  ulcers  to  average  rates 
for  all  facilities  in  Toledo.  Facilities  also  received  the  most  recent  AHCPR  guidelines  on  pressure 
ulcer  prevention  and  were  invited  to  a  symposium  on  topics  related  to  prevention  of  pressure 
ulcers.  The  initiative  was  conducted  from  1996  to  1997,  during  which  facilities  received  four 
quarterly  feedback  reports  on  their  pressure  ulcer  performance  as  compared  to  other  Toledo 
facilities. 

This  was  an  important  initiative  and  merits  a  more  detailed  discussion  than  we  have  afforded  other 
initiatives.  As  an  initiative,  it  incorporated  many  elements  viewed  as  important  by  proponents  of 
quality  improvement  initiatives.  It  was  a  collaborative  public-private  partnership  project  among 
HCFA,  AHCA,  Ohio  Health  Care  Association  (OHCA),  and  the  Ohio  Department  of  Health  using 
non-regulatory  initiatives  to  reduce  the  incidence  and  prevalence  of  pressure  ulcers  for  the 
residents  in  Toledo,  Ohio  nursing  homes.  Also,  there  is  no  question  that  for  most  facilities  with 
respect  to  pressure  ulcers,  there  is  ample  "opportunity  for  improvement."  The  intervention 
emphasizes  both  the  importance  of  systematic  QI  feedback  data  to  providers  as  well  as  an 
educational  "best  practices"  intervention  in  the  form  of  AHCPR  guidelines  and  the  symposium. 
The  information  feedback  to  providers  was  viewed  as  the  most  important  component  of  the 
intervention,  with  each  Toledo  provider  receiving  a  total  of  three  quarterly  report.  All  these 
elements  have  been  viewed  as  important,  indeed  critical,  to  quality  improvement,  and  there  was  a 
clear  expectation  by  the  sponsors  of  this  initiative  that  it  would  be  successful 
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A  Strong  Evaluation 


The  presence  of  core  elements  viewed  as  important  to  the  success  of  non-regulatory  quality 
improvement  initiatives  is  not  in  itself  particularly  remarkable.  However,  the  presence  of  these 
elements  in  combination  with  an  unusually  strong  evaluation  design  are  unprecedented,  at  least  to 
our  knowledge.  The  evaluation  employed  a  quasi-experimental  design  with  a  control/comparison 
group  consisting  of  all  nursing  homes  in  the  Columbus,  Ohio  catchment  area,  nursing  homes  with 
roughly  comparable  pressure  ulcer  measures  who  did  not  receive  the  intervention.  A  pre-post 
analysis  was  conducted  with  two  data  points  prior  to  the  feedback  report,  and  three  data  points 
post-implementation  to  observe  any  impact  from  the  first  or  subsequent  feedback  reports.  The 
multiple  data  points  permit  more  stable  estimates  of  the  interventions'  impact  as  well  as  more  time 
to  observe  a  possible  delayed  impact.  Unfortunately,  it  was  not  possible  to  assess  the  differential 
impact  of  each  of  the  three  intervention  components.  The  outcome  QI  measures,  derived  from 
MDS  data,  dealt  directly  with  pressure  ulcers:  1)  incidence  among  high-risk  residents,  2) 
incidence  among  low-risk  residents;  3)  prevalence  among  high-risk  residents,  and  4)  prevalence 
among  low-risk  residents.  The  analysis  of  the  outcome  indicator  data  was  conducted  by  HCFA 
central  office,  who  had  no  particular  expectation  that  this  intervention  would  be  successful. 

Although  this  was  primarily  a  summative  evaluation  to  determine  the  impact  of  the  intervention 
on  the  outcome  measures,  some  very  limited  formative  elements  were  added  in  order  to  learn 
something  about  why  the  intervention  did  or  did  not  succeed.  Accordingly,  the  initiative  had  an 
independent  contractor,  Abt  Associates,  conduct  a  total  of  22  telephone  interviews  with  a 
stratified  random  sample  of  Toledo  district  nursing  homes.  Topics  discussed  in  the  telephone 
interviews  included:  challenges  in  providing  care  to  residents  at  risk  for  pressure  ulcers;  reaction 
to  the  symposium  or  reasons  for  not  attending;  reaction  to  materials  (data  and  guidelines),  and 
changes  implemented  as  a  result  of  this  initiative  and/or  independently  of  it.306 


Although  not  discussed  in  this  chapter,  the  evaluation  was  further  strengthened  by  other  elements.  If 
improvement  was  found  in  the  outcome  measures  for  Toledo  facilities  and  not  for  the  Columbus  facilities,  it  is 
still  possible  that  factors  other  than  the  intervention  may  be  responsible  For  example,  the  Toledo  facilities  may 
show  an  improvement  due  to  a  kind  of  Hawthorne  effect  -  a  general  awareness  that  they  are  being  observed 
with  a  subsequent  motivation  to  perform  better.  If  so,  this  improvement  could  probably  not  be  sustained  and 
would  onJv  be  temporarv  We  would  not  expect  it  to  be  evident  at  the  third  data  point.  Further,  as  part  of  the 
design,  information  was  collected  on  QIs  unrelated  to  pressure  ulcers  (e.g.,  prevalence  of  falls;  prevalence  of 
problem  behavior  toward  others).  If  pressure  ulcers  improved  because  of  a  generalized  Hawthorne  effect,  as 
descnbed  above,  we  might  expect  improvement  in  these  unrelated  QIs  as  well.  Alternatively,  a  more  plausible 
Hawthorne  effect  might  occur  from  the  awareness  of  the  Toledo  facilities  that  their  MDS  data  with  respect  to 
pressure  ulcers  were  being  observed  by  the  State;  this  could  result  in  a  motivation,  conscious  or  unconscious, 
to  report  better  results.  Hence,  the  improvement  would  only  be  an  improvement  in  reported  pressure  ulcer 
rates,  not  an  actual  improvement.  Under  these  circumstances  of  no  real  change,  we  would  not  expect  an 
improvement  in  other  QIs  related  to  pressure  ulcer  care,  but  not  the  focus  of  this  initiative  (e.g.,  nutntion/wt. 
Loss;  dehvdration;  mobility/bed  fast;  restraints)  This  use  of  QIs  other  than  pressure  ulcers  permits  further 
testing  of  whether  any  observed  improvement  in  pressure  ulcer  rates  is  due  to  the  intervention  and  not  to  other 
factors 
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Results 


The  mean  rates  for  Toledo  and  Columbus  facilities  on  all  four  pressure  ulcer  outcome  indicators 
for  all  five  quarters  are  presented  in  Tables  13.1.  A  casual  inspection  of  the  tables  does  not  reveal 
any  general  improvement  in  these  rates  for  the  Toledo  facilities  as  compared  to  Columbus.  Mean 
incidence  and  prevalence  values  were  calculated  for  the  pre-  and  post-intervention  periods.  The 
Wilcoxon  signed-rank  test,  which  was  used  because  the  data  are  grossly  non-normally  distributed, 
indicated  no  statistically  significant  differences.  Note  that,  because  of  small  numbers,  the  low-risk 
prevalences  and  incidences  are  quite  unstable.  In  addition,  16  facilities,  out  of  a  starting  group  of 
117,  in  the  Toledo  region  were  lost  to  follow-up.  Twenty  out  of  178  facilities  in  the  Columbus 
region  were  also  lost  to  follow-up.  We  have  no  information  on  those  facilities,  so  we  do  not 
know  how  the  loss  of  data  from  them  affected  the  results.  Hence,  there  is  no  evidence, 
whatsoever,  that  the  intervention  was  successful. 
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Exhibit  13.1:  Incidence  and  Prevalence  of  Pressure  Ulcers,  by  Region  and  Date 
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The  qualitative  telephone  interviews  yielded  a  more  positive  picture.  Half  of  the  twenty-two 
facilities  surveyed  reported  making  some  kind  of  change  in  policy  or  procedure  as  a  result  of  the 
information  provided  by  the  pressure  ulcer  initiative.  The  remaining  providers  indicated  that 
changes  in  care  practices  were  not  necessary  or  that  the  initiative  confirmed  that  they  were  already 
doing  the  right  things.  All  facilities  surveyed  said  they  found  the  data  reports  and  AHCPR 
guidelines  helpful  Overall,  respondents  reacted  favorably  to  the  combination  of  intervention 
components  (data,  guidelines,  and  symposium)  used  in  the  initiative.  Several  providers 
appreciated  the  cooperative  nature  of  the  pressure  ulcer  initiative  and  expressed  strong  positive 
feelings  about  the  role  of  regulatory  agencies  in  this  and  similar  projects.  These  laudatory 
comments  notwithstanding,  there  remains  the  fundamental  fact  of  no  improvement.  The  positive 


The  Wilcoxon  signed-rank  test  probability  for  the  difference  in  pre-intervention  and  post-intervention  means. 
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perceptions  coupled  with  no  positive  outcomes  underscores  the  importance  of  a  strong  evaluation 
design;  a  weaker  evaluation  design,  e.g.  one  relying  on  mere  perception  of  change,  would  have 
led  to  misleading  results. 

13.8     Schnelle's  Total  Quality  Management  (TQM):  An  Example  of  Successful  Quality 
Improvement  in  Nursing  Homes? 

Although  there  appear  to  be  examples  of  successful  TQM  interventions  in  a  number  of  health  care 
settings,  particularly  hospitals  with  a  wide  variety  of  administrative  work  processes,308  there  is  a 
noteworthy  absence  of  evidence  supporting  these  interventions  in  nursing  homes.  This  does  not 
mean,  however,  that  residents  status  cannot  be  improved.  With  respect  to  incontinence,  for 
example,  evidence  cited  elsewhere  in  this  Report  indicates  that  incontinence  can  be  reduced  or 
reversed  in  about  one-half  of  all  affected  residents  through  the  use  of  specific  staff  protocols 
known  as  "prompted  voiding"  which  addresses  immobility  and  consequent  inability  to 
independently  toilet  as  a  major  risk  factor  for  incontinence.  Given  the  known,  recognized  care 
processes  that  impact  incontinence  and  other  resident  outcomes,  it  is  puzzling  that  evidence  has 
not  emerged  that  supports  the  effectiveness  of  the  quality  improvement  interventions  discussed 
above  The  evolving  incontinence  research  of  John  Schnelle  and  colleagues,  conducted  over  a 
period  of  10  years,  may  be  an  important  and  instructive  exception. 

13.8.1  Schnelle's  TQM  as  Applied  to  the  Nursing  Home 

As  noted  by  Schnelle,  the  TQM  system  ".  .  .offers  a  conceptually  appealing  approach  that  seems 
to  address  many  of  the  problems  that  have  been  identified  in  health  care  settings."309  Key  to  this 
system  is  a  work-sampling  system  designed  to  identify  the  specific  work  processes  necessary  to 
change  resident  outcomes  and  to  analyze  variation  in  these  work  processes  and  the  impact  of  such 
variations  on  outcomes.  He  distinguishes  this  process  from  the  more  traditional  quality  assurance 
approaches: 

"(1)  TQM  emphasizes  the  importance  of  analyzing  the  variable  effects  of  specific  work 
processes  on  targeted  outcome  measures.  In  contrast,  nursing  homes  primarily  emphasize 
'goal  attainment,'  or  the  achievement  of  arbitrarily  defined  resident  care  standards,  with 
less  emphasis  on  job  processes'  variability  analyses.  (2)  TQM  utilizes  direct  care  workers 


Gustafson,  D.H.  and  Hundt,  A.S.,  1995  "'Findings  of  Innovation  Research  Applied  to  Quality  Management 
Principles  for  Health  Care,"  Health  Care  \fanagement  Review,  20(2):  16-34   See  also  Gustafson,  D.H.,  "Case 
Studies  from  the  Quality  Improvement  Support  System,"  Agency  for  Health  Care  Policy  and  Research, 
Department  of  Health  and  Human  Services,  March  1997. 

Schnelle,  John  F.  Ouslander,  J.,  Ostenveil,  D.,  Blumenthal,  S.,  1993,  "Total  Quality  Management: 
Administrative  and  Clinical  Application  in  Nursing  Homes,"  Journal  of  American  Geriatrics  Society,  41 : 1259- 
1266. 
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to  monitor  the  effects  of  their  own  work  processes  on  outcomes.  Nursing  homes  typically 
perform  monitoring  with  quality  assurance  personnel  who  are  not  directly  engaged  in  the 
resident-related  work  process.  (3)  TQM  emphasizes  frequent  or  even  daily  sampling  of  job 
outcomes  and  correlated  analyses  of  work  processes.  Quality  assurance  monitoring 
efforts  are  less  frequent.  (4)  TQM  emphasizes  the  systematic  collection  of  customer 
satisfaction  information  to  evaluate  all  work  processes."310 

With  respect  to  the  clinical  outcome  of  incontinence,  the  prompted  voiding  procedure  includes 
checking  wetness;  periodically  asking  each  resident  if  he  or  she  is  wet  or  dry;  prompting  the 
resident  to  toilet  at  specified  intervals;  and  praising  appropriate  toileting  311  These  care 
procedures  seem  simple  enough.  But  the  sustained  implementation  of  these  procedures  under  the 
constraints  and  motivations  found  in  most  nursing  homes  is  really  quite  difficult,  as  Schnelle's 
research  demonstrates.  Schnelle  argues  that  "standards  of  care  are  written  for  nursing  homes 
without  a  realistic  assessment  of  whether  there  is  an  intervention  protocol  or  resources  to  meet 
these  standards."312  Consequently,  Schnelle's  quality  improvement  intervention,  derived  from  the 
principle  of  TQM,  focuses  on  the  work  processes  that  are  needed  to  implement  the  care  processes 
that  are  known  to  improve  resident  outcomes.313 

13.8.2  Schnelle's  TQM  Intervention314 

An  incontinence  management  program  was  implemented  in  eight  nursing  homes  distributed 
among  three  states.  These  nursing  homes  had  an  average  incontinence  rate  of  56  percent,  a  rate 
typically  found  nationally.  The  intervention  involved  the  use  of  a  computer-assisted  Incontinence 
Management  System  (IMS)  that  first  required  training  licensed  nursing  and  nursing  assistant  staff 
to  gather  extensive  wetness  data  on  residents  to  first  identify  residents  who  are  appropriate 
candidates  for  prompted  voiding.  Nursing  assistants  were  trained  to  enter  prompted  voiding  data 
into  the  computer.  The  wetness  checks  involved  physically  checking  residents'  undergarments  or 


Schnelle  et  al,  op  cit,  pp.  1 259- 1 260. 

McNees,  P.  M.,  et  al,  "Computer-Aided  Total  Quality  Program  Lowers  Incontinence  Rates,"  Provider,  April 
1993. 

Schnelle,  J.  F.,  Ouslander,  J.  G  ,  and  Cruise,  P  A.  "Policy  Without  Technology:  A  Barrier  to  Improving 
Nursing  Home  Care,"  The  Geroniologisl,  37(4)527-532.  1997. 

Although  there  is  some  overlap  between  Schnelle's  TQM  and  the  American  Health  Care  Association's 
(AHCA)  "Guiding  Principles"  for  long-term  care  quality  improvement,  there  is  an  absence  of  any  attention  in 
AHCA's  approach  to  the  implementation  of  specific  work  processes.  See  Case,  Timothy,  "A  Quality 
Assessment  and  Improvement  System  for  Long-Term  Care,  "  Quality  Management  in  Health  Care,  1996,  4(3), 
15-21. 

Schnelle,  John  F.,  McNees,  P.,  Crooks,  V.,  and  Ouslander,  J  "The  Use  of  a  Computer  Based-Model  to 
Implement  a  Incontinence  Management  Program,"  The  Gerontologist,  35(5)656-665.  1995 
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pads  to  determine  whether  they  were  wet  or  dry.  From  this  baseline  data,  the  computer-assisted 
IMS  generated  a  control  chart,  "  .  .  the  key  tool  for  relating  prompted  voiding  to  resident 
outcomes."  The  control  chart  recorded  the  mean  wetness  rate  for  each  resident  as  well  as  the 
mean  wetness  rate  for  all  residents  in  the  intervention.  Continued  wetness  checks,  entered  into 
the  computer  by  nursing  assistants,  and  randomly  (and  independently)  checked  by  nurses, 
permitted  the  monitoring  of  any  changes  that  fell  outside  of  expected  variation.  These  ongoing 
checks  also  identified  care  givers  and  residents  who  may  not  have  been  delivering  or  receiving  the 
prompted  voiding  protocol.    An  "out-of-control"  (mean  wetness  +  two  standard  deviation)  wet 
check  was  a  trigger  to  analyze  factors  that  may  have  been  contributing  to  a  high  wetness  rates. 

In  addition,  "direct  wet  checks  were  performed  by  independent  research  assistants  with  NH 
(nursing  home)  experience  for  four  weeks  prior  to  the  initiation  of  the  IMS,  and  for  six  months 
following  the  implementation  of  the  system  "  Apart  from  these  wetness  measurements  collected 
by  research  staff, 

".  .  the  primary  dependent  measure  that  reflected  the  nursing  staff  s  ability  to  maintain  the 
program  was  the  internal  random  wet  checks  (control  checks)  that  were  scheduled  by  the 
computer  and  conducted  by  NH  staff.  All  analyses  were  performed  by  the  computer,  and 
hence  the  potential  for  identifying  causes  for  high  wetness  levels,  and  involving  NAs  in  the 
continued  improvement  process,  were  driven  by  these  random-check  data.  Research  staff 
retrieved  these  data  directly  from  the  NHs  computer  by  modem  on  approximately  a 
weekly  basis.  Telephone  feedback  was  given  by  research  staff  to  the  nursing  staff  during 
the  six-month  evaluation  period  in  the  event  that  no  control  data  were  collected,  or  if 
wetness  rates  were  unusually  high  according  to  the  control  chart  data.  No  feedback  was 
given  after  the  six-month  period,  but  more  control  check  data  were  retrieved  from  the  NH 
computers  so  as  to  evaluate  the  NH's  maintenance  of  the  control  check  system  without 
research  staff  support." 

13.8.3  Results  of  Incontinence  Intervention 

Essentially,  the  analysis  consisted  in  determining  changes  in  wetness  rates  of  residents  as 
calculated  by  the  random  wet  checks  completed  by  research  staff.  In  one  sense  the  results  were 
highly  positive  indicating  that  the  TQM  intervention  was  effective:  the  initial  mean  baseline  wet 
rate  for  residents  who  were  selected  for  prompted  voiding  and  who  completed  at  least  one  month 
of  the  intervention  was  3 1  percent.  After  six  months  of  the  intervention,  the  mean  rate  for  these 
residents  had  dropped  to  a  statistically  significant  17  percent.  As  reported,  ".  .  .  the  baseline 
wetness  rate  was  almost  cut  in  half  during  the  first  month  following  the  intervention,  and  staff 
generally  were  able  to  maintain  this  rate  for  the  duration  of  the  six  month  evaluation."315 


Similarly  successful  results  were  obtained  in  a  an  intervention  emphasizing  changing  work  processes,  but 
targeted  toward  reducing  physical  restraints.  See  Schnelle,  John  F.,  et  al,  "Policy  Without  Technology:  A 
Barrier  to  Improving  Nursing  Home  Care,"'  op  cit. 
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In  another  sense,  the  results  were  not  encouraging:  "After  the  six  month  monitoring  phase, 
research  staff  ceased  providing  feedback  to  the  nursing  home  providers.  Within  the  following 
month,  seven  of  the  eight  facilities  terminated  the  incontinence  program."  In  spite  of  the  labor 
intensity  of  this  intervention,  the  initial  willingness  of  these  homes  to  commit  staff  resources  to 
training,  and  the  high  degree  of  involvement  of  external  research  staff,  all  but  one  of  the  eight 
participating  nursing  homes  had  staff  turnover  changes  which  affected  the  internal  dissemination 
and  continuation  of  the  program.  In  addition,  other  informal  evidence  suggests  that,  despite 
educational  efforts  in  all  homes,  only  one  home  involved  the  nursing  assistants  in  the  ongoing 
analysis  and  monitoring  of  the  data  as  required  by  the  intervention.  The  researchers  concluded 
that  ".  .  the  objective  improvement  in  resident  dryness  which  occurred  in  most  homes  was  not  a 
sufficient  'stand-alone  incentive'  for  most  NHs  to  maintain  the  incontinence  management  system. 
The  external  monitoring  and  consultation  provided  by  research  staff  was  obviously  the  key 
variable  related  to  maintenance." 

13.9  Conclusion 

This  chapter  has  discussed  a  wide  variety  of  long-term  care  quality  improvement  initiatives. 
These  kinds  of  non-regulatory  initiatives  with  their  emphasis  upon  CQI  are  viewed  by  AHCA, 
JCAHO,  and  others  as  important  and  effective  mechanisms  for  nursing  home  quality  assurance 
For  some,  it  is  argued  that  they  can  supplant  some  or  a  very  large  part  of  the  normal  survey 
process,  as  proposed  by  the  South  Dakota  Initiative.  We  have  found  essentially  no  evidence  to 
sustain  a  belief  in  the  effectiveness  of  these  initiatives  as  they  are  normally  implemented  in 
nursing  homes.  As  was  noted  above,  the  absence  of  evidence  supporting  these  quality 
interventions  does  not  mean  that  residents'  status  cannot  be  improved.  Nevertheless,  apart  from  a 
well-designed  TQM  intervention  by  Schnelle  and  his  colleagues,316  the  only  initiative  we  could 
find  with  a  strong,  carefully  controlled  evaluation  design,  the  Ohio  Pressure  Ulcer  Initiative  which 
incorporated  many  intervention  elements  thought  essential  to  proponents,  resulted  unmistakably  in 


Although  the  evaluation  by  Schnelle  did  not  employ  a  control/comparison  group  design,  the  before/after  design 
is  defensible  because  there  is  little  reason  to  believe  that  the  historical  changes  in  incontinence  rates  would  be  a 
threat  to  the  internal  validity  of  the  results.  As  noted  in  Chapter  1 9,  incontinence  rates  of  nursing  home 
residents  have  remained  essentially  unchanged  In  addition,  the  outcome  data  on  changes  in  wetness  rates  were 
collected  by  research  staff  independent  of  the  nursing  home  staff  implementing  the  intervention.  The 
importance  of  outcome  data  collection  by  investigators  independent  of  the  nursing  home  staff  should  not  be 
overlooked.  In  several  incontinence  interv  entions  as  well  as  a  physical  restraint  intervention,  the  wetness  rate 
and  physical  restraint  release  rate  recorded  by  nursing  home  staff  was  low  er  and  higher,  respectively,  than  the 
actual  rates  as  recorded  by  the  independent  research  staff  through  direct  observ  ations.  These  findings  are  very 
similar  to  that  found  by  Jeanie  Kayser- Jones  and  colleagues  in  a  study  designed  to  compare  the  estimated 
percentage  of  food  eaten  by  nursing  home  residents  as  recorded  by  the  nursing  home  staff  with  the  estimated 
percentage  for  the  same  residents  at  the  same  meals  as  computed  by  trained  research  assistants: 
'"Overwhelmingly,  the  nursing  staff  tended  to  overestimate  intake.  .  ."  See  Kayser- Jones,  J.,  et  al,  1997 
"Reliability  of  Percentage  Figures  Used  to  Record  the  Dietary  Intake  of  Nursing  Home  Residents,"  Xursing 
Home  Medicine,  5(3)69-76.  Taken  together,  these  observations  would  warrant  caution  in  relying  on  facility 
self-reported  data. 
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no  improvement.  Of  course,  many  of  these  initiatives  are  in  early  stages  of  development,  and  it  is 
always  possible  that  future  evaluations  will  yield  evidence  of  their  effectiveness.317  For  now, 
however,  it  would  be  a  risk  to  the  health  and  safety  of  the  nation's  vulnerable  nursing  home 
population  to  remove  the  protections  of  a  regulatory  system  that  has  some  degree  of 
effectiveness,  as  demonstrated  in  chapters  17-20,  in  lieu  of  quality  improvement  initiatives  of 
unproven  effectiveness. 

Although  Schnelle's  TQM  incontinence  intervention  produced  evidence  of  effectiveness,  the 
positive  outcomes  could  not  be  sustained  after  the  involvement  of  the  external  research  staff 
ceased.  The  prompted  voiding  intervention  required  an  estimated  20  minutes  of  nurse  aide  time 
per  targeted  resident  per  shift,  and  the  investigators  maintained  that  it  is  significantly  more  time- 
consuming  than  simply  changing  people  on  a  schedule  that  is  convenient  to  staff.318  The 
investigators  themselves  questioned  ".  .   how  well  TQM  can  be  implemented  with  a  poorly  paid 
work  force  who  will  be  asked  to  engage  in  multiple  complex  work  processes  designed  to  improve 
both  resident  satisfaction  and  functioning."  Given  the  very  high  level  of  effort  required  to  produce 
the  positive  outcomes  observed  -  but  not  sustained  -  it  is  doubtful  that  this  kind  of  quality 
improvement  intervention  will  be  widely  replicated  or  less  intense  efforts  will  succeed. 

In  spite  of  expectations  of  effectiveness  on  the  part  of  the  proponents  of  initiatives  like  the  Ohio 
project,  there  are  compelling  reasons  to  regard  these  kinds  of  interventions  as  weak.  Consistent 
with  the  Schnelle's  TQM  emphasis  upon  the  detailed  work  processes  through  which  the 
intervention  is  implemented,  it  may  be  too  optimistic  to  view  feedback  data  on  performance  alone, 
or  even  performance  information  together  with  educational  "best  practices"  information,  as 
sufficient  to  change  actual  care  practices.  The  core  problem  may  not  be  lack  of  clinical 
knowledge.  Addressing  underlying  causes  may  in  turn  require  some  attention  to  organizational 
issues  for  which  there  is  little  knowledge.  There  are  human  resource  management  factors  that 


It  is  quite  understandable  that  those  individuals  and  organizations  involved  in  the  development  of  these 
initiatives  would  also  play  a  role  in  their  implementation.  It  is  also  understandable  that  they  would  have  an 
interest  in  evaluation  efforts  to  demonstrate  the  effectiveness  of  the  initiative.  It  is  important  that  an  evaluator 
seek  the  input  of  program  implementors,  particularly  for  formative  evaluations.  Also,  for  summative 
evaluations,  it  is  important  to  determine  if  the  evaluator's  view  of  the  desired  outcomes  of  the  intervention  are 
the  same  as  the  program  implementors.  However,  when  the  program  intervention  has  been  finalized  and  a 
summative  evaluation  is  necessary,  the  developmental  and  implementation  phases  of  the  intervention  should  be 
separated  from  the  evaluative  phase,  i.e.,  conducted  by  different  organizations/individuals  This  separation  of 
roles  does  not  often  occur  in  thus  area  of  quahtv  improvement  initiatives,  which  may  account  for  why  the  one 
initiative  that  had  a  strong  quasi-experimental  design  produced  such  discouraging  findings. 

This  kind  of  response  is  very  similar  to  that  of  teachers  who  confront  disruptive  students  in  their  classrooms.  It 
is  far  easier  to  recommend  them  for  testing,  where  they  are  labeled  as  learning  disabled  or  some  other 
disabihtv,  and  eventually  placed  in  special  education  and  removed  from  the  classroom,  than  to  address  all  the 
difficult  classroom  instructional  issues.  See  Jane  Knitzer,  et  al.,  (1990)  At  the  Schoolhouse  Door:  An 
Examination  of  Programs  and  Policies  for  Children  with  Behavioral  and  Emotional  Problems.  New  York: 
Bank  Street  College  of  Education. 
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may  explain  why  some  homes  fail  to  provide  adequate  care.  For  example,  determining  whether 
the  underlying  problem  is  ineffective  administration319  and  what  is  needed  to  remedy  the 
underlying  problem320  may  require  a  level  of  knowledge  and  skill  that  is  not  commonly  found. 
Consistent  with  Schnelle's  findings,  it  is  also  likely  that  there  will  be  a  need  to  turn  to  staffing 
issues,  particularly  those  related  to  nurse  aides  who  provide  the  bulk  of  the  direct  care.  As  we 
indicated  at  the  onset  of  this  Report,  nurse  staffing  issues  are  beyond  the  Report's  scope. 

Even  if  evidence  in  support  of  some  quality  improvement  initiatives  emerges  in  the  future,  there 
remains  the  question  of  how  these  initiatives  relate  to  the  survey  and  enforcement  systems.  To 
address  this  question  we  have  examined  the  inherent  conflict  between  the  traditional  surveyor  role 
of  solely  determining  compliance  to  standards  and  an  expanded  role  of  information  transfer.  It 
appears  that  there  is  one  program  intervention,  the  State  of  Washington's  QANs,  which  attempts 
to  balance  these  two  conflicting  roles.  Although  we  have  found  no  support  for  supplanting  any 
part  of  the  survey  with  the  quality  improvement  initiatives  discussed  above,  the  QANs  appear  to 
enhance  and  not  replace  the  survey.  Further,  the  QAN  program  is  not  a  stand-alone  effort,  but 
has  been  implemented  Statewide.  As  we  indicated  above,  "A  QAN  .  .  .  increases  the  frequency 
with  which  a  representative  of  the  State  survey  agency  has  the  opportunity  to  view  and  assess  the 
conditions  in  a  nursing  facility.  .  .  Ultimately,  all  other  things  being  equal,  more  frequent 
assessment  should  lead  to  improvement  in  the  quality  of  services  .  .  .".  Of  course,  this 
intervention  may  not  in  fact  lead  to  actual  improvement.  Hence,  we  think  this  initiative  merits 
further  development  and  a  truly  independent  and  strong  evaluation. 
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